-- Logs begin at Tue 2021-08-10 02:41:24 UTC, end at Tue 2021-08-10 03:58:08 UTC. -- Aug 10 03:30:00.751866 dv-cinder-782390-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 03:30:00.760637 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 03:30:00.762615 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 10 03:30:00 2021] *** Aug 10 03:30:00.762615 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 03:30:00.762615 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 03:30:00.762615 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: nodename: dv-cinder-782390-8-iscsi Aug 10 03:30:00.762615 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: machine: x86_64 Aug 10 03:30:00.762615 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: clock source: unix Aug 10 03:30:00.762615 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: pcre jit disabled Aug 10 03:30:00.762615 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: detected number of CPU cores: 4 Aug 10 03:30:00.762615 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: current working directory: / Aug 10 03:30:00.762615 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: detected binary path: /usr/bin/uwsgi-core Aug 10 03:30:00.762615 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: your processes number limit is 47680 Aug 10 03:30:00.763231 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: your memory page size is 4096 bytes Aug 10 03:30:00.763231 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: detected max file descriptor number: 2048 Aug 10 03:30:00.763231 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: lock engine: pthread robust mutexes Aug 10 03:30:00.763231 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: thunder lock: enabled Aug 10 03:30:00.763231 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 03:30:00.763231 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 10 03:30:00.807162 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: Python main interpreter initialized at 0x55cec7dde9c0 Aug 10 03:30:00.807162 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: python threads support enabled Aug 10 03:30:00.807162 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: your server socket listen backlog is limited to 100 connections Aug 10 03:30:00.807162 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: your mercy for graceful operations on workers is 90 seconds Aug 10 03:30:00.807538 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 03:30:00.807613 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: *** Operational MODE: preforking *** Aug 10 03:30:00.807839 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: *** uWSGI is running in multiple interpreter mode *** Aug 10 03:30:00.807839 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: spawned uWSGI master process (pid: 93415) Aug 10 03:30:00.808050 dv-cinder-782390-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 03:30:00.809564 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: spawned uWSGI worker 1 (pid: 93416, cores: 1) Aug 10 03:30:00.809564 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: spawned uWSGI worker 2 (pid: 93417, cores: 1) Aug 10 03:30:00.809564 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 03:30:02.554007 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 03:30:02.554007 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: from cryptography.utils import int_from_bytes Aug 10 03:30:02.554783 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 03:30:02.554783 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: from cryptography.utils import int_from_bytes Aug 10 03:30:02.556723 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 03:30:02.556723 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: from cryptography.utils import int_from_bytes Aug 10 03:30:02.557323 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 03:30:02.557323 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: from cryptography.utils import int_from_bytes Aug 10 03:30:05.378090 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 03:30:05.378624 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 03:30:05.378813 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 03:30:05.379172 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 03:30:05.379428 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 03:30:05.379814 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.380148 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.380486 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.380809 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.381139 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.381451 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.381767 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.382092 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.382409 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.382666 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.382977 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.383298 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-782390-8-iscsi {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.383617 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.383919 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.384244 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.384565 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.384863 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.385181 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.385489 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.385974 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.386416 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.386721 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.387038 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.387427 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.387674 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.387979 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.388319 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.388627 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.388946 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.389250 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.389607 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 03:30:05.390045 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-782390-8-iscsi {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.390155 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 03:30:05.390297 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.390297 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.390514 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 03:30:05.390604 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.390740 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 03:30:05.390906 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 03:30:05.391014 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.391246 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.391360 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.392052 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.392173 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.392399 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.392584 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.392719 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.392872 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.393014 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.393229 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.393344 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.393643 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.393748 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.393971 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.394071 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.394285 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.394380 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.394585 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.394713 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.394862 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.394999 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.395173 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.395275 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.395494 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.395582 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-782390-8-iscsi {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.395797 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.395933 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.396107 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.396284 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.396441 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.396567 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.396651 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.396813 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.397002 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.397168 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.397309 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.397479 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.397638 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.397802 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.397950 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.398093 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.398225 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.398405 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.398508 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.398670 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.398756 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.398974 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.399061 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.399281 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.399404 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.399585 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.399717 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.399892 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.400048 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.400224 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.400366 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.400510 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.400647 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.400804 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.400947 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.401096 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.401248 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.401417 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.401624 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-782390-8-iscsi {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.401786 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.401927 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.402076 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.402215 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.402361 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.402523 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.402674 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.402931 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.403075 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.403233 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.403386 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.403543 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.403693 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.403845 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.403992 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.404134 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.404337 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.404464 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.404555 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.404766 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.404842 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.405079 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.405182 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.405387 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.405510 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.405694 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.405786 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.405994 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.406108 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.406301 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.406385 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.406609 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.406693 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.406910 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.407005 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.407186 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.407289 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.408007 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.408100 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.408307 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.408405 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.408614 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.408695 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.408930 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.409011 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.409234 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.409319 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.409540 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.409615 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.409847 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.410041 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.410204 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.410352 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.410456 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.410538 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.410725 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.410893 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.411224 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.411374 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.411588 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.411740 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.411880 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.412033 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.412254 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.412402 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.412526 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.412677 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.412827 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.413029 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.413175 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.413347 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.413503 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.413649 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.413780 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.414040 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.414183 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.414323 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.414535 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.414691 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.414854 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.415160 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.415278 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.415461 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.415764 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.415895 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.416072 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.416319 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.416463 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.416701 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.416947 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.417057 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.417414 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.417518 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.417626 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.417904 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.418050 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.418185 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.418509 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.418656 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.418795 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.419099 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.419368 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.419491 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.419663 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.419802 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.419974 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.420067 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.420304 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.420551 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.420718 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.420900 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.421044 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.421184 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.421333 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.421501 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.421821 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.421969 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.422127 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.422283 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.422442 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.422707 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.422852 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.423052 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.423342 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.423502 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.423712 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.423848 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.424053 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.424244 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.424386 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.424719 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.424858 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.425043 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.425241 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.425360 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.425673 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.425763 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.425988 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.426231 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.426325 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.426613 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.426783 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.426931 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.427223 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.427359 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.427547 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.427695 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.427855 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.428162 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.428291 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.428516 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.428694 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.428834 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.428975 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.429178 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.429326 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.429414 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.429720 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.429873 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.430047 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.430190 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.430379 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.430697 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.430857 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.431036 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.431277 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.431429 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.431683 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.431842 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.431995 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.432152 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.432362 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.432520 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.432665 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.432893 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.433058 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.433245 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.433400 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.433554 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.433697 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.433840 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.434164 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.434314 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.434507 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.434690 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.434800 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.435102 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.435311 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.435469 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.435620 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.435774 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.435997 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.436160 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.436389 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.436535 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.436676 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.436894 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.437052 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.437227 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.437382 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.437533 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.437847 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.438011 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.438179 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.438434 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.438536 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.438809 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.438980 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.439152 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.439410 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.439541 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.439725 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.440029 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.440136 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.440448 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.440590 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.440785 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.440869 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.440943 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.441245 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.441345 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.441562 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.441753 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.441914 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.442165 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.442294 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.442478 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.442790 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.442938 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.443103 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.443293 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.443434 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.443710 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.443852 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.444105 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.444368 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.444521 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.444671 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.444820 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.445004 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.445180 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.445307 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.445632 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.445773 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.446002 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.446249 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.446394 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.446564 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.446795 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.446956 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.447277 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.447438 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:30:05.447583 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.447795 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.447957 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.448096 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.448379 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.448469 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.448683 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.448951 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.449045 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.449276 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.449499 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.449585 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.449887 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.450024 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.450193 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.450500 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.450693 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.450795 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.450875 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.451083 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.451269 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.451422 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.451728 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.451819 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.452072 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.452300 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.452440 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.452757 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.452848 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.453081 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.453286 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.453382 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.453700 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.453849 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.454546 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.454866 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.454964 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.455263 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.455363 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.455578 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.455766 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.455899 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.456229 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.456369 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.456554 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.456865 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.456959 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.457188 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.457498 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.457589 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.457817 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.458069 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.458153 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.458425 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.458655 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.458748 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.use_db_reconnect = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.459045 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.459258 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.459384 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.459694 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.459851 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.460005 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.460354 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.460456 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.460670 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.460983 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.461116 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.461296 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.461607 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.461719 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.461963 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.462189 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.462419 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.462984 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.463608 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.463728 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.463728 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.463892 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.463976 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.463976 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.464121 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.464187 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.464327 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.464419 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.464631 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.464892 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.464979 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.465254 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.465343 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.465566 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.465870 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.465976 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.466200 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.466411 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.466629 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.466792 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.467022 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.467117 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.467427 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.467730 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.467730 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.467913 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.469244 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.469244 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.469761 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.469855 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.470453 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.470525 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.470525 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.470648 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.470726 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.470793 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.470872 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.470872 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.470991 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.471055 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.471349 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.471439 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.471659 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.471983 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.472072 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.472319 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.472617 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.472719 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.472930 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.473145 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.473232 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.473534 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.474306 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.475609 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.475609 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.477787 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.478030 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.478030 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.478198 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.478295 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.478295 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.478435 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.478522 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.478522 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.478664 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.478664 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.478894 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.478894 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479013 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479077 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479077 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479200 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479273 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479273 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479404 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479472 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479472 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479598 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479669 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479669 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479786 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479850 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479850 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.479985 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.480164 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.480502 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.480604 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.480808 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.481084 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.481172 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.481405 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.481674 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.481760 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.482003 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.482258 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.482346 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.482593 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.482834 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.482924 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.483197 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.483408 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.483494 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.483838 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.484008 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.484104 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.484616 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.485917 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.486235 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.486235 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.486407 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.486484 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.486484 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.486787 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.486872 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.486872 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.487014 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.487092 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.487092 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.487220 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.487286 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.487550 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.487639 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.488094 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.488094 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.488409 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.488506 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.488722 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.488928 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.489022 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.489302 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.489569 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.489686 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.489878 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.489975 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.490194 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.490447 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.490570 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.490797 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.491016 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.491174 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.491390 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.491574 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.491697 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.492004 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.492138 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.492349 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.492637 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.492752 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.492934 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.493239 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.493341 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.493548 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.493828 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.493956 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.494142 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.494393 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.494482 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.494757 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.494965 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.495060 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.495341 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.495545 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.495632 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.495932 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.496120 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.496259 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.496568 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.496713 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.496870 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.497445 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.497552 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.497757 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.498061 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.498147 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.498367 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.498671 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.498776 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.498969 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.499245 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.499406 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.499595 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.499869 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.500035 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.500272 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.500491 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.500643 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.500822 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.501073 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.501214 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.501448 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.501656 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.501743 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.502005 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.502102 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.502330 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.502415 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.502632 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.502718 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.502933 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.503028 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.503237 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.503323 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.503558 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.503644 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.503866 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.503967 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.504169 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.504335 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.504495 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.504590 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.504797 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.504903 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.505231 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.505442 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.505527 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.505605 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.505845 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.505956 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.506076 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.506170 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.506431 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.506543 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.506700 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.use_db_reconnect = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.506788 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.507007 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.507092 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.507321 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.507430 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.507633 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.507738 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.507937 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.508046 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.508276 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.508380 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.508585 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.508677 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.508904 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.509054 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.509212 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.509337 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.509517 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.509649 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.509840 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.510029 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.510151 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.510268 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.510445 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.510572 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.510769 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.510899 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.511085 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.511233 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.511388 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.511520 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.511697 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.511827 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.511999 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.512136 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.512338 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.512458 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.512625 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.512740 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.512940 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.513074 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.513247 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.513368 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.513558 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.513665 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.513867 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.513998 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.514225 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.514360 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.514477 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.514590 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.514773 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.514897 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.515078 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.515195 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.515389 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.515511 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.515690 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.515811 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.515993 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.516112 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.516322 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.516444 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.517154 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.517278 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.517460 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.517580 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.517762 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.517881 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.518496 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.518496 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.518719 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.518836 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.518960 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.519076 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.519208 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.519326 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.519529 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.519650 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.519780 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.519921 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.520092 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.520227 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.520426 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.520548 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.520738 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.520869 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.521053 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.521175 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.521366 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.521489 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.521676 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.521808 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.521981 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.522101 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.522318 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.522450 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.522603 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.522736 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.522909 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.523031 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.523210 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.523330 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.523516 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.523638 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.523856 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.523986 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.524291 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.524550 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.524697 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.524885 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.525051 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.525203 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.525448 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.525570 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.525828 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.525952 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.526147 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.526322 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.526475 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.526636 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.526801 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.526963 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.527094 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.527390 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.527563 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.527692 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.527809 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.527987 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.528109 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.528342 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.528516 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.528661 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.528882 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.529016 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.529156 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.529289 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.529484 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.529621 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.529878 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.530011 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.530128 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.530227 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.530394 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.530526 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.530694 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.530815 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.530996 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.531117 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.531307 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.531433 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.531607 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.531737 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.531913 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.532034 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.532319 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.532449 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.532630 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.532749 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.532943 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.533116 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.533264 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.533383 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.533535 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.533655 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.533884 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.534062 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.534202 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.534363 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.534484 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.534690 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.534863 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.534988 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.535104 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.535314 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.535423 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.535641 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.535773 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.535953 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.536082 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.536284 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.536397 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.536600 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.536710 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.536909 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.537127 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.537243 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.537344 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.537499 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.537610 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.537804 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.537937 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.538102 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.538222 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.538408 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.538528 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.538713 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.538851 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.539020 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.539154 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.539321 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.539439 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.539618 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.539755 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.539934 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.540068 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.540294 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.540403 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.540585 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.540710 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.540936 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.541053 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.541239 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.541359 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.541946 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.542138 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.542344 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.542586 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.542720 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.542839 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.542958 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.543076 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.543177 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.543275 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.543374 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.543487 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.543599 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.543701 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.543809 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.543910 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.544010 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.544109 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.544287 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.544408 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.544523 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.544646 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.544763 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.544931 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.545064 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.545266 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.545387 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.545594 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.545716 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.545911 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.546033 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.546231 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.546360 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.546571 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.546750 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.546889 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.547008 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.547156 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.547278 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.547488 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.547674 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.548432 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.548558 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.548675 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.548790 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.548909 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.549052 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.549191 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.549318 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.549487 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.549608 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.549833 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.549992 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.550122 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.550239 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.550355 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.550468 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.550657 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.550789 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.550958 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.551066 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.551296 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.551420 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.551593 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.551790 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.551913 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.552028 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.552188 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.552383 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.552549 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.552686 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.552851 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.552979 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.553154 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.553274 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.553541 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.553732 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.553867 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.553984 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.554135 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.554254 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.554438 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.554618 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.554739 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.554854 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.555051 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.555171 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.555358 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.555498 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.555657 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.555780 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.555958 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.556084 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.556307 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.556455 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.556624 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.556826 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.556958 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.557077 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.557230 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.557354 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.557530 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.557652 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.557832 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.557952 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.558148 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.558271 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.558456 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.558765 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.558915 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.559112 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.559237 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.559432 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.559568 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.559756 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.559905 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.560071 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.560261 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.560388 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.560523 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.560689 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.560793 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.561001 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.561144 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.561304 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.561406 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.561617 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.561735 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.561919 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.562010 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.562224 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.562315 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.562534 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.562630 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.562842 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.562958 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.563149 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.563237 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.563515 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.563622 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.563825 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.563919 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.564130 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.564274 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.564475 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.564565 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.564809 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.564922 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.565103 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.565194 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.565437 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.565524 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.565849 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.565949 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.566033 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.566119 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.566328 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.566416 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.566628 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.566724 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.566958 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.567070 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.567272 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.567360 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.567587 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.567682 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.567900 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.567987 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.568248 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.568340 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.568544 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.568680 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.568857 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.568944 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.569185 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.569275 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.569483 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.569571 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.569833 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.569918 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.570144 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.570240 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.570456 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.570544 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.570772 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.570858 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.571070 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.571322 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.571452 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.571618 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.571732 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.571995 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.572121 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.572347 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.572438 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.572675 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.572765 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.572976 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.573061 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.573300 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.573388 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.573604 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.573724 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.573921 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.574070 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.574236 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.574362 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.574584 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.574675 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.574895 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.574996 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.575203 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.575291 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.575527 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.575619 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.575837 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.575971 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.576141 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.576249 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.576486 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.576573 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.576798 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.576898 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.577132 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.577336 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.577424 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.577694 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.577789 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.578017 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.578111 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.578346 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.578439 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.578653 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.578794 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.578964 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.579564 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.579782 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.579871 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.580105 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.580241 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.580443 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.580541 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.580756 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.580854 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.581068 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.581204 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.581381 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.581469 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.581692 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.581837 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.582001 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.582091 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.583243 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.583357 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.583444 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.583527 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.585815 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.585994 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.586162 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.586307 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.586404 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.586497 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.586657 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.586744 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.586824 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.586903 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.586981 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.587060 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.587152 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.587234 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.587313 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.587388 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.587461 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.587573 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.587715 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.587805 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.587805 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.587940 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.588007 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.588097 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.588260 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.588387 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.588503 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.588618 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.588736 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.588893 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.589025 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.589173 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.589271 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.589365 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.589365 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.589561 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.590283 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.590384 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.590453 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.590594 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.590714 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.590839 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.590951 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.591090 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.591178 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.591298 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.591394 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.591534 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.591679 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.591766 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.591850 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.591940 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.592186 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.592414 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.592572 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.592720 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.593047 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.593208 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.593491 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.593706 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.593980 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.594463 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.594659 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.594920 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.595022 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.595268 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.595509 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.595648 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.595982 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.596329 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.596520 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.596688 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.596918 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.597079 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.597266 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.597398 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.597584 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.597729 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.597899 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.598050 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.598213 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.598504 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.598602 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.598863 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.598952 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.599202 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.599292 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.599535 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.599630 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.599885 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.599972 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.600271 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.600362 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.600543 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.600633 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.600908 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.601002 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.601211 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.601313 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.601520 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.601619 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.601909 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.602052 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.602207 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.602307 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.602547 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.602751 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.602940 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.603029 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.603272 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.603377 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.603597 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.603724 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.603960 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.604049 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.604304 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.604417 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.604631 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.604720 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.604950 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.605037 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.605267 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.605453 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.605584 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.605852 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.605957 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.606282 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.606377 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.606627 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.606715 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.606946 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.607066 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.607255 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.607424 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.607594 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.607823 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.607911 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.608231 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.608320 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.608658 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.608798 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.609073 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.609158 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.609409 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.609496 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.609727 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.609884 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.610038 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.610119 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.610900 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.611003 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.611211 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.611400 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.611521 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.611848 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.611974 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.612250 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.612380 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.612547 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.612714 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.612876 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.613212 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.613307 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.613565 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.613662 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.613917 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.614020 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.614233 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.614398 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.614550 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.614762 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.614856 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.615046 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.615168 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.615380 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.615541 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.615690 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.615862 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.616007 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.616165 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.616366 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.616505 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.616730 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.616836 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.617055 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.617162 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.617366 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.617454 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.617726 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.617813 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.618037 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.618135 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.618353 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.618443 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.618665 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.618760 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.618977 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.619073 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.619349 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.619453 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.619638 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.619735 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.619967 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.620055 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.621031 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.621528 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.621837 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.621991 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.622109 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.622502 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.622631 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.622710 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.622710 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.622850 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.622850 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.622980 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.623048 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.623114 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.623186 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.623317 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.623431 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.623506 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.623786 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.623876 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.624236 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.624342 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.624670 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.624920 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.625004 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.625073 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.625390 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.625647 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.625730 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.625798 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.626044 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.626155 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.626363 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.626459 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.626609 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.626691 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.627153 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.627304 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.627390 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.627390 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.627517 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.627584 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.627656 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.627736 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.627863 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.628515 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.628634 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.628989 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.629081 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.629160 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.629229 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.629303 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.629377 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.629582 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.629685 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.629840 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.629929 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.630146 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.630295 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.630469 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.630687 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.630777 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.631044 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.631139 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.631361 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.631448 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.631670 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.631759 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.631973 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.632070 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.632296 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.632417 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.632607 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.632748 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.632913 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.633000 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 03:30:05.633219 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.633529 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.633824 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.634151 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.634516 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.634752 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.635138 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.635371 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.635673 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.636164 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.636505 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.636816 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.637128 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.637432 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.637744 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.638158 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.638350 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.638655 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.638962 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.639265 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.639592 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.639895 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.640214 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.640532 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.640842 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.641164 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.641474 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.642415 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.642726 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.643147 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.643999 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.644469 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.644802 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.645179 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.645859 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.646331 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.647176 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.647364 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.647663 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.649404 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.649404 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.649404 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.649404 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.649877 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.650324 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.650767 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.651291 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.651676 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.652001 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.652438 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.653047 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.653379 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.653708 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.654045 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.654346 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.654661 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.654977 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.655291 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.655610 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.655943 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.656283 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.656888 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.657327 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.657639 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.657982 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.658149 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG oslo_db.sqlalchemy.engines [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:30:05.658294 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.658603 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.658941 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.659282 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.659617 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.659939 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.660326 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.660581 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.660885 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.661194 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.661539 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.661877 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.662198 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.662523 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.662836 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.663148 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.663459 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.663781 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.664091 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.664427 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.664745 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.665054 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.665371 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.665680 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.666002 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.666312 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.666630 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.667021 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.667244 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.667552 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.667885 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.668234 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.668539 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.668847 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.669173 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.669477 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.669796 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.670114 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.670433 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.670741 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.671070 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.671379 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.671686 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.671993 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.672411 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.672635 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.673468 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.673794 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.674123 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.674428 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.674754 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.675068 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.675397 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.675711 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.676020 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.676367 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.676678 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.676996 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.677297 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.677603 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.677995 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.678227 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.678548 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.678871 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.679194 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.679553 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.680127 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.680486 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.680880 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.681257 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:30:05.681527 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 03:30:05.704765 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_db.sqlalchemy.engines [None req-433c3166-0bdc-4ecc-a9ee-c9aba19dc9ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:30:05.741909 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.context [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c015e818-e9f7-45c5-a54b-4b6aaf8bfd26(cell1) {{(pid=93416) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 03:30:05.746167 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG oslo_concurrency.lockutils [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:30:05.748016 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG oslo_concurrency.lockutils [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:30:05.748855 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG oslo_concurrency.lockutils [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:30:05.750826 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG oslo_concurrency.lockutils [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:30:05.762033 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG oslo_db.sqlalchemy.engines [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:30:05.762892 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG oslo_db.sqlalchemy.engines [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:30:05.787296 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.context [None req-433c3166-0bdc-4ecc-a9ee-c9aba19dc9ee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c015e818-e9f7-45c5-a54b-4b6aaf8bfd26(cell1) {{(pid=93417) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 03:30:05.791693 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-433c3166-0bdc-4ecc-a9ee-c9aba19dc9ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:30:05.793649 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-433c3166-0bdc-4ecc-a9ee-c9aba19dc9ee None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:30:05.794221 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-433c3166-0bdc-4ecc-a9ee-c9aba19dc9ee None None] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:30:05.796484 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-433c3166-0bdc-4ecc-a9ee-c9aba19dc9ee None None] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:30:05.811640 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_db.sqlalchemy.engines [None req-433c3166-0bdc-4ecc-a9ee-c9aba19dc9ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:30:05.814467 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_db.sqlalchemy.engines [None req-433c3166-0bdc-4ecc-a9ee-c9aba19dc9ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:30:06.127268 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG oslo_db.sqlalchemy.engines [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:30:06.193887 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_db.sqlalchemy.engines [None req-433c3166-0bdc-4ecc-a9ee-c9aba19dc9ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:30:06.592520 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: WARNING keystonemiddleware.auth_token [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 03:30:06.599410 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: WARNING keystonemiddleware.auth_token [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 03:30:06.664862 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: WARNING keystonemiddleware.auth_token [None req-433c3166-0bdc-4ecc-a9ee-c9aba19dc9ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 03:30:06.671570 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: WARNING keystonemiddleware.auth_token [None req-433c3166-0bdc-4ecc-a9ee-c9aba19dc9ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 03:30:06.950062 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: WARNING keystonemiddleware.auth_token [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 03:30:06.955839 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: WARNING keystonemiddleware.auth_token [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 03:30:06.961518 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cec7dde9c0 pid: 93416 (default app) Aug 10 03:30:06.963899 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:30:06.965171 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] 10.222.0.21 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002016 Aug 10 03:30:06.965637 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 1/1] 10.222.0.21 () {50 vars in 789 bytes} [Tue Aug 10 03:30:06 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:30:07.022288 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: WARNING keystonemiddleware.auth_token [None req-433c3166-0bdc-4ecc-a9ee-c9aba19dc9ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 03:30:07.027866 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: WARNING keystonemiddleware.auth_token [None req-433c3166-0bdc-4ecc-a9ee-c9aba19dc9ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 03:30:07.033122 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55cec7dde9c0 pid: 93417 (default app) Aug 10 03:31:33.854113 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:31:33.855888 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 Aug 10 03:31:33.856625 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 2/2] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 10 03:31:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:31:34.291759 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-00ab5ad7-f690-4c64-be39-c7a2f7a27a8c admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:31:34.322668 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-00ab5ad7-f690-4c64-be39-c7a2f7a27a8c admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.458108 Aug 10 03:31:34.332633 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 1/3] 10.222.0.21 () {60 vars in 1292 bytes} [Tue Aug 10 03:31:33 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:31:36.519851 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:31:36.520892 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-dd4e17b7-6f48-4db5-b52b-1bbce41de5c1 None None] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 10 03:31:36.521278 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 3/4] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 10 03:31:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:31:36.603871 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-6beb79f9-2c91-4a23-8bc3-fbc946965141 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "name": "cirros256", "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0}} {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:36.623003 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:31:36.623003 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: warnings.warn(msg) Aug 10 03:31:36.719334 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-6beb79f9-2c91-4a23-8bc3-fbc946965141 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.191094 Aug 10 03:31:36.720342 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 2/5] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 10 03:31:36 2021] POST /compute/v2.1/flavors => generated 407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:31:36.948418 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-a2c118a0-ad6c-4846-bfb3-75a2044d92c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:36.950779 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:31:36.950779 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: warnings.warn(msg) Aug 10 03:31:37.082385 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-a2c118a0-ad6c-4846-bfb3-75a2044d92c7 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.352962 Aug 10 03:31:37.100720 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 4/6] 10.222.0.21 () {64 vars in 1336 bytes} [Tue Aug 10 03:31:36 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:31:39.274645 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-6beb79f9-2c91-4a23-8bc3-fbc946965141 admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:31:39.276400 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-6beb79f9-2c91-4a23-8bc3-fbc946965141 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002153 Aug 10 03:31:39.277319 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 3/7] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 10 03:31:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:31:39.409896 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-d87b8cd9-3751-40b1-bd20-297d66ac2d87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "ram": 512}} {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:39.427992 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:31:39.427992 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: warnings.warn(msg) Aug 10 03:31:39.571557 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-d87b8cd9-3751-40b1-bd20-297d66ac2d87 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.286994 Aug 10 03:31:39.572126 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 5/8] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 10 03:31:39 2021] POST /compute/v2.1/flavors => generated 404 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:31:39.584468 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-bbc7972f-7cfa-4abe-82eb-7d6679d62b2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:39.585968 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:31:39.585968 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: warnings.warn(msg) Aug 10 03:31:39.700783 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-bbc7972f-7cfa-4abe-82eb-7d6679d62b2e admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119910 Aug 10 03:31:39.701886 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 4/9] 10.222.0.21 () {64 vars in 1336 bytes} [Tue Aug 10 03:31:39 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:31:41.946489 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-d87b8cd9-3751-40b1-bd20-297d66ac2d87 admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:31:41.947481 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-d87b8cd9-3751-40b1-bd20-297d66ac2d87 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 10 03:31:41.947883 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 6/10] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 10 03:31:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:31:42.022610 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-bfee929e-5536-459c-b97d-37f3c9d1339e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:42.155786 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-bfee929e-5536-459c-b97d-37f3c9d1339e admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.200153 Aug 10 03:31:42.156792 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 5/11] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 10 03:31:41 2021] POST /compute/v2.1/flavors => generated 404 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:31:42.169373 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-47a32287-67b5-4028-8911-1dbaca711d92 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:42.304570 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-47a32287-67b5-4028-8911-1dbaca711d92 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.139048 Aug 10 03:31:42.316907 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 7/12] 10.222.0.21 () {64 vars in 1336 bytes} [Tue Aug 10 03:31:42 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:31:44.615143 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-bfee929e-5536-459c-b97d-37f3c9d1339e admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:31:44.616166 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-bfee929e-5536-459c-b97d-37f3c9d1339e admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 10 03:31:44.616595 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 6/13] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 10 03:31:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:31:44.679331 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-99c9bd73-1327-4075-a027-a0e4ddc8bd6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "disk": 10, "name": "ds2G"}} {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:44.788417 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-99c9bd73-1327-4075-a027-a0e4ddc8bd6d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.164856 Aug 10 03:31:44.789050 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 8/14] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 10 03:31:44 2021] POST /compute/v2.1/flavors => generated 404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:31:44.801973 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-1c4ab488-86a8-48c5-b133-e0e9453ff400 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:44.945537 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-1c4ab488-86a8-48c5-b133-e0e9453ff400 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.147136 Aug 10 03:31:44.949047 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 7/15] 10.222.0.21 () {64 vars in 1336 bytes} [Tue Aug 10 03:31:44 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:31:47.194400 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-99c9bd73-1327-4075-a027-a0e4ddc8bd6d admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:31:47.195403 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-99c9bd73-1327-4075-a027-a0e4ddc8bd6d admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 10 03:31:47.196058 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 9/16] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 10 03:31:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:31:47.262008 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-679e0c63-f426-4f5a-b96b-2902f581b23d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "vcpus": 4, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:47.348369 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-679e0c63-f426-4f5a-b96b-2902f581b23d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143950 Aug 10 03:31:47.351161 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 8/17] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 10 03:31:47 2021] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:31:47.362222 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-1c90331b-24b7-47a7-b22d-f898190c6460 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:47.517939 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-1c90331b-24b7-47a7-b22d-f898190c6460 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160032 Aug 10 03:31:47.518665 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 10/18] 10.222.0.21 () {64 vars in 1336 bytes} [Tue Aug 10 03:31:47 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:31:49.845112 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-679e0c63-f426-4f5a-b96b-2902f581b23d admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:31:49.846364 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-679e0c63-f426-4f5a-b96b-2902f581b23d admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 Aug 10 03:31:49.847338 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 9/19] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 10 03:31:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:31:49.952322 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-b05ea626-7508-4a10-9ab8-9b20115ff757 admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:31:49.987153 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-b05ea626-7508-4a10-9ab8-9b20115ff757 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.126260 Aug 10 03:31:49.988371 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 11/20] 10.222.0.21 () {60 vars in 1292 bytes} [Tue Aug 10 03:31:49 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:31:52.823440 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-679e0c63-f426-4f5a-b96b-2902f581b23d admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:31:52.824884 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-679e0c63-f426-4f5a-b96b-2902f581b23d admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002060 Aug 10 03:31:52.825430 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 10/21] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 10 03:31:52 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:31:52.906064 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-8b195a6b-ca55-43f6-88cd-3018a3660958 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "disk": 1}} {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:53.018926 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-8b195a6b-ca55-43f6-88cd-3018a3660958 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.184914 Aug 10 03:31:53.019513 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 12/22] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 10 03:31:52 2021] POST /compute/v2.1/flavors => generated 402 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:31:53.033153 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-9c03f6a7-3fd3-4fd3-b888-fe5dba1336a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:53.157455 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-9c03f6a7-3fd3-4fd3-b888-fe5dba1336a7 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128703 Aug 10 03:31:53.160532 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 11/23] 10.222.0.21 () {64 vars in 1333 bytes} [Tue Aug 10 03:31:53 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:31:55.449450 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-8b195a6b-ca55-43f6-88cd-3018a3660958 admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:31:55.450466 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-8b195a6b-ca55-43f6-88cd-3018a3660958 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 10 03:31:55.450862 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 13/24] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 10 03:31:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:31:55.520315 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-e8959352-e17a-4a55-b6cb-a704fe8a2d4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "id": "2", "swap": 0, "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:55.627348 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-e8959352-e17a-4a55-b6cb-a704fe8a2d4a admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.169098 Aug 10 03:31:55.627916 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 12/25] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 10 03:31:55 2021] POST /compute/v2.1/flavors => generated 405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:31:55.649400 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-5d183556-d614-48b0-9813-c7db9a3dcdf8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:55.769098 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-5d183556-d614-48b0-9813-c7db9a3dcdf8 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123482 Aug 10 03:31:55.769688 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 14/26] 10.222.0.21 () {64 vars in 1333 bytes} [Tue Aug 10 03:31:55 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:31:58.001426 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-e8959352-e17a-4a55-b6cb-a704fe8a2d4a admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:31:58.003032 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-e8959352-e17a-4a55-b6cb-a704fe8a2d4a admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001612 Aug 10 03:31:58.003032 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 13/27] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 10 03:31:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:31:58.066895 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-cd0548c6-402e-4b25-9e88-ba13cb5ca6c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "3"}} {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:58.218072 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-cd0548c6-402e-4b25-9e88-ba13cb5ca6c3 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.207808 Aug 10 03:31:58.218714 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 15/28] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 10 03:31:58 2021] POST /compute/v2.1/flavors => generated 406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:31:58.234279 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-fde13ccb-1f2e-472f-bc6b-32c256341b6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:31:58.334301 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-fde13ccb-1f2e-472f-bc6b-32c256341b6e admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106722 Aug 10 03:31:58.335030 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 14/29] 10.222.0.21 () {64 vars in 1333 bytes} [Tue Aug 10 03:31:58 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:32:00.553823 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-cd0548c6-402e-4b25-9e88-ba13cb5ca6c3 admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:00.554954 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-cd0548c6-402e-4b25-9e88-ba13cb5ca6c3 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Aug 10 03:32:00.555590 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 16/30] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 10 03:32:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:32:00.629697 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-a6d0750f-babf-49b6-8332-b9f225240a4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "swap": 0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:32:00.743363 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-a6d0750f-babf-49b6-8332-b9f225240a4b admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.179929 Aug 10 03:32:00.744231 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 15/31] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 10 03:32:00 2021] POST /compute/v2.1/flavors => generated 405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:32:00.757239 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-76eec6cd-f525-48b5-8e74-16cd3b66c442 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:32:00.906973 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-76eec6cd-f525-48b5-8e74-16cd3b66c442 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.153345 Aug 10 03:32:00.908325 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 17/32] 10.222.0.21 () {64 vars in 1333 bytes} [Tue Aug 10 03:32:00 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:32:03.155197 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-a6d0750f-babf-49b6-8332-b9f225240a4b admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:03.156828 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-a6d0750f-babf-49b6-8332-b9f225240a4b admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 Aug 10 03:32:03.157220 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 16/33] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 10 03:32:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:32:03.220852 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-821fae63-041e-41fc-82da-5497a0bc87ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0}} {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:32:03.347213 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-821fae63-041e-41fc-82da-5497a0bc87ec admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.182852 Aug 10 03:32:03.347811 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 18/34] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 10 03:32:03 2021] POST /compute/v2.1/flavors => generated 408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:32:03.361244 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-18521087-9a5d-4e96-965e-d3b820f4b8d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:32:03.488938 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-18521087-9a5d-4e96-965e-d3b820f4b8d5 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132060 Aug 10 03:32:03.489827 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 17/35] 10.222.0.21 () {64 vars in 1333 bytes} [Tue Aug 10 03:32:03 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:32:43.407883 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-821fae63-041e-41fc-82da-5497a0bc87ec admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:43.408946 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-821fae63-041e-41fc-82da-5497a0bc87ec admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 10 03:32:43.409343 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 19/36] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 10 03:32:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:32:43.468651 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-da4b5ae5-8c97-44a4-a00b-e0dd68628a25 admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:43.485633 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-da4b5ae5-8c97-44a4-a00b-e0dd68628a25 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069626 Aug 10 03:32:43.486187 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 18/37] 10.222.0.21 () {60 vars in 1292 bytes} [Tue Aug 10 03:32:43 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:32:44.948749 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-821fae63-041e-41fc-82da-5497a0bc87ec admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:44.950321 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-821fae63-041e-41fc-82da-5497a0bc87ec admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Aug 10 03:32:44.950725 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 20/38] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 10 03:32:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:32:45.145823 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-fbe3c7aa-c8c3-415c-84fa-c44c243d554c admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:45.151444 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.wsgi [None req-fbe3c7aa-c8c3-415c-84fa-c44c243d554c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 03:32:45.151949 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-fbe3c7aa-c8c3-415c-84fa-c44c243d554c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:32:45.152781 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-fbe3c7aa-c8c3-415c-84fa-c44c243d554c admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.062363 Aug 10 03:32:45.153298 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 19/39] 10.222.0.21 () {60 vars in 1191 bytes} [Tue Aug 10 03:32:45 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:45.163131 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-7a8defb0-62df-4015-b0fe-771a010b62f6 admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:45.184871 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-7a8defb0-62df-4015-b0fe-771a010b62f6 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024682 Aug 10 03:32:45.185458 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 21/40] 10.222.0.21 () {60 vars in 1211 bytes} [Tue Aug 10 03:32:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:32:45.196094 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-bf47eb1b-8fca-448d-b324-89c8f34a16e5 admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:45.218133 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-bf47eb1b-8fca-448d-b324-89c8f34a16e5 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025644 Aug 10 03:32:45.218708 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 20/41] 10.222.0.21 () {60 vars in 1211 bytes} [Tue Aug 10 03:32:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:32:45.228975 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-73d388b0-c3be-4ac7-87ed-8eff827894ce admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:45.234709 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.wsgi [None req-73d388b0-c3be-4ac7-87ed-8eff827894ce admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 03:32:45.235342 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-73d388b0-c3be-4ac7-87ed-8eff827894ce admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:32:45.236150 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-73d388b0-c3be-4ac7-87ed-8eff827894ce admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010934 Aug 10 03:32:45.236706 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 22/42] 10.222.0.21 () {60 vars in 1191 bytes} [Tue Aug 10 03:32:45 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:46.590032 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-bf47eb1b-8fca-448d-b324-89c8f34a16e5 admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:46.591678 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-bf47eb1b-8fca-448d-b324-89c8f34a16e5 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Aug 10 03:32:46.592109 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 21/43] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 10 03:32:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:32:46.782372 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-b3d322eb-94bc-4fb2-b922-d95641d85a7f admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:46.787557 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.wsgi [None req-b3d322eb-94bc-4fb2-b922-d95641d85a7f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 03:32:46.788106 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-b3d322eb-94bc-4fb2-b922-d95641d85a7f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:32:46.788964 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-b3d322eb-94bc-4fb2-b922-d95641d85a7f admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.059287 Aug 10 03:32:46.789466 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 23/44] 10.222.0.21 () {60 vars in 1191 bytes} [Tue Aug 10 03:32:46 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:46.799408 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-88a73488-1c4a-40e7-a71f-6987f23c5435 admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:46.813279 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-88a73488-1c4a-40e7-a71f-6987f23c5435 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017455 Aug 10 03:32:46.813811 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 22/45] 10.222.0.21 () {60 vars in 1211 bytes} [Tue Aug 10 03:32:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:32:46.823654 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-e06ac4fc-84ca-42ee-9c1b-6afe74e88a52 admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:46.837806 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-e06ac4fc-84ca-42ee-9c1b-6afe74e88a52 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017596 Aug 10 03:32:46.838340 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 24/46] 10.222.0.21 () {60 vars in 1211 bytes} [Tue Aug 10 03:32:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:32:46.847880 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-1e55a984-498d-4936-a10f-384d06564057 admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:46.853110 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.wsgi [None req-1e55a984-498d-4936-a10f-384d06564057 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 03:32:46.853670 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-1e55a984-498d-4936-a10f-384d06564057 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:32:46.854450 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-1e55a984-498d-4936-a10f-384d06564057 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.010066 Aug 10 03:32:46.854946 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 23/47] 10.222.0.21 () {60 vars in 1191 bytes} [Tue Aug 10 03:32:46 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:48.223220 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-e06ac4fc-84ca-42ee-9c1b-6afe74e88a52 admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:48.224326 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-e06ac4fc-84ca-42ee-9c1b-6afe74e88a52 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Aug 10 03:32:48.224740 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 25/48] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 10 03:32:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:32:48.421840 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-0111198c-59e8-49d7-8ab8-895558913a03 admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:48.428712 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.wsgi [None req-0111198c-59e8-49d7-8ab8-895558913a03 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 03:32:48.429271 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-0111198c-59e8-49d7-8ab8-895558913a03 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:32:48.430059 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-0111198c-59e8-49d7-8ab8-895558913a03 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.064600 Aug 10 03:32:48.430569 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 24/49] 10.222.0.21 () {60 vars in 1194 bytes} [Tue Aug 10 03:32:48 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:48.444314 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-97adbeba-617f-4d04-be40-959a2d59b12f admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:48.464579 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-97adbeba-617f-4d04-be40-959a2d59b12f admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026776 Aug 10 03:32:48.465159 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 26/50] 10.222.0.21 () {60 vars in 1211 bytes} [Tue Aug 10 03:32:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:32:48.475690 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-cce6edce-86f2-40f7-a499-50109ef3970e admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:48.489560 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-cce6edce-86f2-40f7-a499-50109ef3970e admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017307 Aug 10 03:32:48.490122 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 25/51] 10.222.0.21 () {60 vars in 1211 bytes} [Tue Aug 10 03:32:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:32:48.502149 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-98e6b846-8f1e-43cd-84ff-758af85db547 admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:48.507945 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.wsgi [None req-98e6b846-8f1e-43cd-84ff-758af85db547 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 03:32:48.508789 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-98e6b846-8f1e-43cd-84ff-758af85db547 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:32:48.509297 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-98e6b846-8f1e-43cd-84ff-758af85db547 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.011393 Aug 10 03:32:48.509815 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 27/52] 10.222.0.21 () {60 vars in 1194 bytes} [Tue Aug 10 03:32:48 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:49.860964 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-cce6edce-86f2-40f7-a499-50109ef3970e admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:49.861977 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-cce6edce-86f2-40f7-a499-50109ef3970e admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 10 03:32:49.862371 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 26/53] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 10 03:32:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:32:50.059919 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-2c1c0750-46b0-4f2e-ba54-44498bb6feca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:32:50.208599 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-2c1c0750-46b0-4f2e-ba54-44498bb6feca admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.204458 Aug 10 03:32:50.209150 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 28/54] 10.222.0.21 () {64 vars in 1236 bytes} [Tue Aug 10 03:32:50 2021] POST /compute/v2.1/flavors => generated 404 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:32:51.580025 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-cce6edce-86f2-40f7-a499-50109ef3970e admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:51.581071 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-cce6edce-86f2-40f7-a499-50109ef3970e admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Aug 10 03:32:51.581469 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 27/55] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 10 03:32:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:32:51.785907 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-b8e90af9-54d2-4321-967c-bae14531550b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:32:51.894936 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-b8e90af9-54d2-4321-967c-bae14531550b admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.164925 Aug 10 03:32:51.895490 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 29/56] 10.222.0.21 () {64 vars in 1236 bytes} [Tue Aug 10 03:32:51 2021] POST /compute/v2.1/flavors => generated 405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:32:53.254138 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-cce6edce-86f2-40f7-a499-50109ef3970e admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:53.255155 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-cce6edce-86f2-40f7-a499-50109ef3970e admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 10 03:32:53.255548 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 28/57] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 10 03:32:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:32:53.449319 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-4527aa6e-c15f-40fa-bdf7-fdd5ea4c2f25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:32:53.558119 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-4527aa6e-c15f-40fa-bdf7-fdd5ea4c2f25 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.161517 Aug 10 03:32:53.558663 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 30/58] 10.222.0.21 () {64 vars in 1236 bytes} [Tue Aug 10 03:32:53 2021] POST /compute/v2.1/flavors => generated 407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:32:54.927879 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-cce6edce-86f2-40f7-a499-50109ef3970e admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:54.928931 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-cce6edce-86f2-40f7-a499-50109ef3970e admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 10 03:32:54.929326 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 29/59] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 10 03:32:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:32:55.126874 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-ffad4c80-303d-4f5a-9ccc-4ed8fe4aa67f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:32:55.294335 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-ffad4c80-303d-4f5a-9ccc-4ed8fe4aa67f admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.223820 Aug 10 03:32:55.294893 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 31/60] 10.222.0.21 () {64 vars in 1236 bytes} [Tue Aug 10 03:32:55 2021] POST /compute/v2.1/flavors => generated 409 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:32:56.663917 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-cce6edce-86f2-40f7-a499-50109ef3970e admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:56.664964 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-cce6edce-86f2-40f7-a499-50109ef3970e admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 10 03:32:56.665360 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 30/61] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 10 03:32:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:32:56.857319 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-268b4b2d-b2f9-4aeb-8739-2ae688c7d6fd admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:32:56.876932 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-268b4b2d-b2f9-4aeb-8739-2ae688c7d6fd admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.071705 Aug 10 03:32:56.877463 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 32/62] 10.222.0.21 () {60 vars in 1203 bytes} [Tue Aug 10 03:32:56 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:33:44.620562 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-cce6edce-86f2-40f7-a499-50109ef3970e admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:33:44.621575 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-cce6edce-86f2-40f7-a499-50109ef3970e admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002034 Aug 10 03:33:44.621996 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 31/63] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 10 03:33:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:33:44.680175 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-432d1f2b-840f-42d5-84ce-62d1fd854a45 admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:33:44.699752 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-432d1f2b-840f-42d5-84ce-62d1fd854a45 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070924 Aug 10 03:33:44.700343 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 33/64] 10.222.0.21 () {60 vars in 1292 bytes} [Tue Aug 10 03:33:44 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:33:44.722173 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-8f7a4a94-487e-4721-995c-fa9acc6cf4f4 admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:33:44.731582 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-8f7a4a94-487e-4721-995c-fa9acc6cf4f4 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012979 Aug 10 03:33:44.732176 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 32/65] 10.222.0.21 () {60 vars in 1283 bytes} [Tue Aug 10 03:33:44 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:33:44.744845 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-8c9121f0-1996-429e-a870-c68d85c9a461 admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:33:44.753377 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-8c9121f0-1996-429e-a870-c68d85c9a461 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012386 Aug 10 03:33:44.753922 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 34/66] 10.222.0.21 () {60 vars in 1286 bytes} [Tue Aug 10 03:33:44 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:33:44.766073 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-837bbd4d-3f08-43f6-a86e-3f611bc51b6f admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:33:44.773889 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-837bbd4d-3f08-43f6-a86e-3f611bc51b6f admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011500 Aug 10 03:33:44.774544 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 33/67] 10.222.0.21 () {60 vars in 1286 bytes} [Tue Aug 10 03:33:44 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:33:44.786385 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-99a52239-800c-4937-9ed2-d23081ad1818 admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:33:44.794833 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-99a52239-800c-4937-9ed2-d23081ad1818 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012072 Aug 10 03:33:44.795379 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 35/68] 10.222.0.21 () {60 vars in 1283 bytes} [Tue Aug 10 03:33:44 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:35:44.025604 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-04a5f0e3-b58f-4b2c-b59f-e8009a86bce2 tempest-verify_tempest_config-1504059866 tempest-verify_tempest_config-1504059866-project] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:35:44.027607 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-04a5f0e3-b58f-4b2c-b59f-e8009a86bce2 tempest-verify_tempest_config-1504059866 tempest-verify_tempest_config-1504059866-project] 10.222.0.21 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.130490 Aug 10 03:35:44.028148 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 34/69] 10.222.0.21 () {58 vars in 1134 bytes} [Tue Aug 10 03:35:43 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:37:18.637498 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-99a52239-800c-4937-9ed2-d23081ad1818 admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:37:18.638514 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-99a52239-800c-4937-9ed2-d23081ad1818 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 10 03:37:18.638901 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 36/70] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 10 03:37:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:37:18.900978 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-ba6910c9-16c5-456b-b697-eba6fb058df4 admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:37:18.902122 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:37:18.902122 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: warnings.warn(msg) Aug 10 03:37:18.903675 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-ba6910c9-16c5-456b-b697-eba6fb058df4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:37:18.904116 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-ba6910c9-16c5-456b-b697-eba6fb058df4 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:37:18.905021 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-ba6910c9-16c5-456b-b697-eba6fb058df4 admin admin] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:37:18.905450 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-ba6910c9-16c5-456b-b697-eba6fb058df4 admin admin] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:37:18.940740 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-ba6910c9-16c5-456b-b697-eba6fb058df4 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.158007 Aug 10 03:37:18.941315 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 35/71] 10.222.0.21 () {60 vars in 1194 bytes} [Tue Aug 10 03:37:18 2021] GET /compute/v2.1/os-services => generated 791 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:37:20.460728 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-99a52239-800c-4937-9ed2-d23081ad1818 admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:37:20.461736 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-99a52239-800c-4937-9ed2-d23081ad1818 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 10 03:37:20.462127 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 37/72] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 10 03:37:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:37:20.659261 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-f889508a-a7bf-440d-98f1-42b5241231c6 admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:37:20.660464 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:37:20.660464 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: warnings.warn(msg) Aug 10 03:37:20.662650 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-f889508a-a7bf-440d-98f1-42b5241231c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:37:20.663092 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-f889508a-a7bf-440d-98f1-42b5241231c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:37:20.663966 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-f889508a-a7bf-440d-98f1-42b5241231c6 admin admin] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:37:20.664382 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-f889508a-a7bf-440d-98f1-42b5241231c6 admin admin] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:37:20.683819 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-f889508a-a7bf-440d-98f1-42b5241231c6 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.079621 Aug 10 03:37:20.684421 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 36/73] 10.222.0.21 () {60 vars in 1194 bytes} [Tue Aug 10 03:37:20 2021] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:37:32.520859 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-99a52239-800c-4937-9ed2-d23081ad1818 admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:37:32.521879 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-99a52239-800c-4937-9ed2-d23081ad1818 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 Aug 10 03:37:32.522276 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 38/74] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 10 03:37:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:37:32.721429 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-699257fe-8054-47bd-86d4-b9d9091c0d89 admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:37:32.722647 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:37:32.722647 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: warnings.warn(msg) Aug 10 03:37:32.724843 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-699257fe-8054-47bd-86d4-b9d9091c0d89 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:37:32.725289 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-699257fe-8054-47bd-86d4-b9d9091c0d89 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:37:32.726086 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-699257fe-8054-47bd-86d4-b9d9091c0d89 admin admin] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:37:32.726513 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-699257fe-8054-47bd-86d4-b9d9091c0d89 admin admin] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:37:32.751823 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-699257fe-8054-47bd-86d4-b9d9091c0d89 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.086800 Aug 10 03:37:32.752427 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 37/75] 10.222.0.21 () {60 vars in 1194 bytes} [Tue Aug 10 03:37:32 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:37:34.248949 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: DEBUG nova.api.openstack.wsgi [None req-99a52239-800c-4937-9ed2-d23081ad1818 admin admin] Calling method '>' {{(pid=93416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:37:34.250450 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: INFO nova.api.openstack.requestlog [None req-99a52239-800c-4937-9ed2-d23081ad1818 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001814 Aug 10 03:37:34.251361 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: [pid: 93416|app: 0|req: 39/76] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 10 03:37:34 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:37:34.450223 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG nova.api.openstack.wsgi [None req-0186f17f-d3c6-4b0e-a395-fa5df62c4600 admin admin] Calling method '>' {{(pid=93417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:37:34.451416 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:37:34.451416 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: warnings.warn(msg) Aug 10 03:37:34.452974 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-0186f17f-d3c6-4b0e-a395-fa5df62c4600 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:37:34.453414 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-0186f17f-d3c6-4b0e-a395-fa5df62c4600 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:37:34.454281 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-0186f17f-d3c6-4b0e-a395-fa5df62c4600 admin admin] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:37:34.454706 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: DEBUG oslo_concurrency.lockutils [None req-0186f17f-d3c6-4b0e-a395-fa5df62c4600 admin admin] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:37:34.481434 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: INFO nova.api.openstack.requestlog [None req-0186f17f-d3c6-4b0e-a395-fa5df62c4600 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.087134 Aug 10 03:37:34.482019 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: [pid: 93417|app: 0|req: 38/77] 10.222.0.21 () {60 vars in 1194 bytes} [Tue Aug 10 03:37:34 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:38:32.693500 dv-cinder-782390-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 03:38:32.694102 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: Tue Aug 10 03:38:32 2021 - graceful shutdown triggered... Aug 10 03:38:32.694537 dv-cinder-782390-8-iscsi devstack@n-api.service[93416]: Gracefully killing worker 1 (pid: 93416)... Aug 10 03:38:32.694890 dv-cinder-782390-8-iscsi devstack@n-api.service[93417]: Gracefully killing worker 2 (pid: 93417)... Aug 10 03:38:33.694618 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: worker 1 buried after 1 seconds Aug 10 03:38:33.694618 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: worker 2 buried after 1 seconds Aug 10 03:38:33.694618 dv-cinder-782390-8-iscsi devstack@n-api.service[93415]: goodbye to uWSGI. Aug 10 03:38:33.696304 dv-cinder-782390-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 10 03:38:33.696862 dv-cinder-782390-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 03:38:33.699698 dv-cinder-782390-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 03:38:33.710526 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 03:38:33.713189 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 10 03:38:33 2021] *** Aug 10 03:38:33.713364 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 03:38:33.713532 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 03:38:33.713532 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: nodename: dv-cinder-782390-8-iscsi Aug 10 03:38:33.713532 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: machine: x86_64 Aug 10 03:38:33.713532 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: clock source: unix Aug 10 03:38:33.713532 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: pcre jit disabled Aug 10 03:38:33.713532 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: detected number of CPU cores: 4 Aug 10 03:38:33.713532 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: current working directory: / Aug 10 03:38:33.713532 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: detected binary path: /usr/bin/uwsgi-core Aug 10 03:38:33.713532 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: your processes number limit is 47680 Aug 10 03:38:33.713532 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: your memory page size is 4096 bytes Aug 10 03:38:33.713532 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: detected max file descriptor number: 2048 Aug 10 03:38:33.713532 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: lock engine: pthread robust mutexes Aug 10 03:38:33.714653 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: thunder lock: enabled Aug 10 03:38:33.714653 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 03:38:33.714653 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 10 03:38:33.759131 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: Python main interpreter initialized at 0x5636404f89c0 Aug 10 03:38:33.759131 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: python threads support enabled Aug 10 03:38:33.759131 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: your server socket listen backlog is limited to 100 connections Aug 10 03:38:33.759131 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: your mercy for graceful operations on workers is 90 seconds Aug 10 03:38:33.759671 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 03:38:33.759671 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: *** Operational MODE: preforking *** Aug 10 03:38:33.759857 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: *** uWSGI is running in multiple interpreter mode *** Aug 10 03:38:33.759857 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: spawned uWSGI master process (pid: 108424) Aug 10 03:38:33.764775 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: spawned uWSGI worker 1 (pid: 108439, cores: 1) Aug 10 03:38:33.764775 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: spawned uWSGI worker 2 (pid: 108440, cores: 1) Aug 10 03:38:33.764775 dv-cinder-782390-8-iscsi devstack@n-api.service[108424]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 03:38:33.760102 dv-cinder-782390-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 03:38:35.603300 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 03:38:35.603300 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: from cryptography.utils import int_from_bytes Aug 10 03:38:35.604030 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 03:38:35.604030 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: from cryptography.utils import int_from_bytes Aug 10 03:38:35.614390 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 03:38:35.614390 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: from cryptography.utils import int_from_bytes Aug 10 03:38:35.615029 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 03:38:35.615029 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: from cryptography.utils import int_from_bytes Aug 10 03:38:38.136595 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 03:38:38.137127 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 03:38:38.137331 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 03:38:38.137697 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 03:38:38.137961 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 03:38:38.138408 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.139294 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.139294 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.139483 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.139695 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.140035 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.140394 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.140714 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.141048 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.141312 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.141633 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.141960 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-782390-8-iscsi {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.142284 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.143151 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.143427 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.143745 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.144247 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.144715 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.145208 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.145888 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.146864 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.146864 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.147124 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.147393 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.147651 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.147969 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.148413 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.148642 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.148928 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.149240 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.149648 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-782390-8-iscsi {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.149968 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.150296 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.150613 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.151069 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.151349 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.151647 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.151968 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.152322 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.152636 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.152967 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.153292 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.153612 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.153935 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.154241 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.154610 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.154858 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.155182 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.155498 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.155803 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.156055 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.156389 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.156712 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.157035 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.157359 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.157611 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.157861 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.158185 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.158569 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.158879 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.159685 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.159995 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.160330 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.160659 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.160967 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.161275 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.161581 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.161903 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.162069 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 03:38:38.162546 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.162710 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 03:38:38.162859 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.163013 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 03:38:38.163160 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.163321 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 03:38:38.163471 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.163619 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 03:38:38.163776 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.163924 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.164071 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.164363 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.164553 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.164868 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.165023 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.165192 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.165400 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.165609 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.165781 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.165930 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.166085 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.166242 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.166401 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.166684 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.166854 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.166854 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.167164 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.167164 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.167472 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.167619 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.167775 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.167923 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-782390-8-iscsi {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.168077 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.168378 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.168540 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.168540 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.168826 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.168982 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.169134 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.169295 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.169450 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.169606 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.169756 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.169902 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.170049 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.170214 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.170370 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.170525 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.170680 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.170856 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.171114 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.171265 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.171412 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.171558 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.171717 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.171866 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.172026 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.172186 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.172363 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.172512 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.172658 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.172816 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.172992 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.173149 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.173297 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.173451 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.173609 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.173765 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.173927 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.174076 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.174076 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.174386 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-782390-8-iscsi {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.174597 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.175183 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.175375 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.176524 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.176769 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.176998 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.177378 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.177603 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.177836 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.178074 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.178295 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.178506 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.178713 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.178930 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.179152 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.179385 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.179603 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.179813 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.180016 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.180255 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.180496 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.180727 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.180960 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.181346 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.181567 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.181783 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.182015 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.182228 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.182466 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.182682 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.182888 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.183102 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.183332 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.183556 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.183764 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.183979 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.184213 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.184468 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.184692 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.184927 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.185179 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.185537 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.185879 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.186138 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.186355 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.186566 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.186905 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.187118 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.187290 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.187448 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.187601 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.187869 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.188102 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.188403 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.188570 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.188714 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.188863 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.189004 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.189144 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.189282 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.189436 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.189576 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.189724 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.189871 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.190019 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.190171 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.190353 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.190605 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.190605 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.191312 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.191536 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.191693 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.191953 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.192107 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.192854 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.193045 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.193203 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.193373 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.193523 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.193664 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.193829 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.194072 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.194233 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.194392 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.194537 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.194686 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.194833 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.195063 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.195292 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.195487 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.195719 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.195865 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.196006 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.196155 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.196463 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.197028 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.197193 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.197628 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.197786 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.197944 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.198124 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.198287 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.198544 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.198716 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.198881 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.199024 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.199236 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.199397 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.199539 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.199539 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.199865 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.200091 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.200289 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.200446 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.200587 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.200738 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.200889 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.201043 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.201194 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.201335 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.201481 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.201741 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.201900 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.202109 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.202281 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.202429 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.202579 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.202727 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.202879 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.203033 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.203182 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.203331 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.203471 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.203616 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.203757 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.203909 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.203909 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.204211 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.204381 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.204525 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.204679 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.204842 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.204992 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.205626 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.205883 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.206030 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.206184 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.206334 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.206476 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.206615 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.206761 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.206901 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.207053 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.207195 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.207352 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.207508 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.207649 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.207788 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.207926 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.208073 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.208231 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.208389 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.208533 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.208680 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.208819 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.208959 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.209098 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.209257 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.209405 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.209405 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.209699 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.209841 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.209841 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.210123 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.210272 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.210272 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.210552 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.210692 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.210692 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.210981 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.211124 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.211124 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.211408 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.211561 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.211721 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.211957 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.211957 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.212261 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.212416 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.212564 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.212719 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.212719 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.212997 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.213145 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.213293 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.213433 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.213582 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.213722 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.213862 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.214009 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.214156 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.214303 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:38:38.214462 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.214612 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.214760 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.214924 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.215073 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.215227 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.215383 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.215524 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.215663 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.215802 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.215972 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.216128 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.216337 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.216489 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.216630 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.216779 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.216919 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.217067 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.217220 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.217362 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.217501 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.217640 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.217778 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.217929 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.218078 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.218218 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.218357 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.218495 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.218651 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.218800 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.218947 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.219096 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.219235 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.219374 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.219598 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.219742 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.219889 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.220029 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.220175 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.220374 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.220530 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.220692 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.221392 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.221625 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.221798 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.221970 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.222207 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.222358 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.222580 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.222724 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.222872 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.223023 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.223173 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.223395 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.223559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.223701 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.223841 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.223994 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.224136 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.224335 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.224482 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.224629 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.224777 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.224932 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.225074 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.225213 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.225364 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.225512 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.225653 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.225806 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.225955 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.226095 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.226234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.226382 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.226535 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.226676 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.226816 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.226954 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.226954 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.227229 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.227414 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.227414 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.227701 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.227850 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.227850 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.228125 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.228302 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.228302 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.228581 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.228727 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.228727 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.229000 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.229157 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.229306 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.229452 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.229452 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.229733 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.229882 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.230030 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.230170 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.230308 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.use_db_reconnect = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.230446 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.230586 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.230734 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.230734 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.231045 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.231195 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.231400 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.231605 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.231758 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.231900 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.232047 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.232240 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.232390 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.232531 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.232687 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.232945 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.233116 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.233259 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.233398 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.233556 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.233707 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.233856 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.234003 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.234143 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.234294 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.234454 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.234596 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.234737 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.234876 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.235025 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.235164 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.235316 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.235457 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.235596 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.235743 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.235885 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.236032 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.236186 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.236361 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.236517 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.236657 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.237058 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.237219 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.237374 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.237522 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.237669 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.237810 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.237994 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.238147 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.238288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.238435 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.238590 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.238769 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.238916 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.239065 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.239222 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.239371 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.239518 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.239664 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.239804 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.239963 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.240106 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.240271 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.240417 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.240564 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.240712 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.240887 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.241067 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.241242 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.241386 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.241386 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.241664 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.241664 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.241931 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.241931 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.242212 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.242212 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.242491 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.242638 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.242778 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.242927 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.243074 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.243222 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.243372 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.243512 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.243650 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.243788 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.243934 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.244074 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.244295 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.244453 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.244602 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.244751 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.244902 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.245054 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.245203 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.245344 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.245483 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.245621 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.245759 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.245911 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.246052 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.246201 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.246348 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.246494 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.246633 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.246791 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.246938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.247079 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.247218 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.247218 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.247482 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.247634 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.247634 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.use_db_reconnect = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.247908 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.248054 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.248218 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.248720 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.248876 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.249029 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.249178 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.249320 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.249461 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.249612 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.249753 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.249893 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.250033 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.250172 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.250319 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.250468 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.250608 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.250765 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.250913 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.251062 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.251202 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.251351 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.251492 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.251639 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.251787 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.251935 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.252104 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.252294 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.252451 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.252594 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.252917 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.253099 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.253257 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.253467 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.253615 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.253756 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.253896 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.254037 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.254191 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.254351 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.254493 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.254641 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.254803 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.254969 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.255120 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.255269 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.255416 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.255557 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.255703 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.255853 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.256002 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.256143 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.256318 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.256461 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.256600 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.256909 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.257124 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.257279 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.257420 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.257560 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.257708 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.257860 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.258002 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.258148 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.258289 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.258430 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.258588 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.258781 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.258976 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.259132 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.259280 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.259432 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.259587 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.259729 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.259877 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.260028 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.260175 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.260375 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.260530 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.260670 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.260810 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.260962 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.261111 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.261251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.261402 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.261550 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.261692 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.261843 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.261986 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.262125 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.262271 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.262418 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.262565 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.262714 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.262865 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.263004 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.263152 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.263293 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.263431 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.263580 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.263727 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.263867 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.264014 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.264168 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.264343 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.264508 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.264655 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.264817 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.264963 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.264963 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.265251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.265398 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.265551 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.265697 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.265842 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.265842 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.266127 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.266127 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.266424 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.266424 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.266713 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.266865 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.267021 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.267021 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.267310 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.267310 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.268082 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.268082 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.268454 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.268603 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.268756 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.268903 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.269066 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.269221 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.269383 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.269383 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.269675 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.269822 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.269977 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.270137 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.270285 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.270438 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.270584 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.270736 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.270882 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.271052 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.271208 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.271362 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.271517 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.271664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.271808 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.271966 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.272120 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.272298 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.272447 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.272601 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.272761 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.272908 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.273072 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.273226 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.273380 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.273528 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.273682 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.273839 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.273993 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.274147 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.274310 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.274310 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.274669 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.274866 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.275043 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.275202 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.275359 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.275526 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.275876 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.276080 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.276251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.276406 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.276564 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.276794 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.276952 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.277107 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.277254 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.277418 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.277574 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.277731 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.277885 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.277885 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.278164 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.278326 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.278326 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.278620 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.278775 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.278775 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.279067 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.279215 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.279215 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.279516 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.279671 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.279671 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.279957 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.280104 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.280104 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.280449 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.280611 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.280759 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.280918 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.281073 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.281220 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.281376 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.281522 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.281667 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.281825 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.281974 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.282126 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.282280 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.282434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.282582 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.282737 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.282737 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.283032 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.283194 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.283869 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.284043 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.284209 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.284371 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.284517 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.284675 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.284832 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.284987 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.285136 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.285280 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.285435 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.285582 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.285745 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.285902 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.286057 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.286282 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.286439 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.286587 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.286740 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.286901 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.287048 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.287202 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.287355 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.287509 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.287509 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.287819 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.287967 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.287967 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.288306 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.288468 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.288468 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.288762 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.288915 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.288915 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.289199 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.289347 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.289347 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.289643 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.289808 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.289808 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.290096 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.290241 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.290241 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.290534 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.290689 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.290689 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.290975 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.291135 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.291365 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.291516 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.291516 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.291814 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.291968 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.292125 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.292299 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.292602 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.292778 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.292928 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.293082 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.293244 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.293399 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.293548 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.293695 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.293864 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.294013 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.294299 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.294473 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.294625 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.294770 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.294916 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.295074 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.295231 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.295385 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.295539 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.295694 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.295848 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.296015 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.296163 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.296335 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.296492 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.296751 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.296993 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.297154 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.297310 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.297458 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.297611 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.297767 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.297767 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.298055 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.298214 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.298214 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.298501 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.298647 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.298803 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.298991 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.298991 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.299287 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.299434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.299434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.299734 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.299888 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.299888 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.300178 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.300442 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.300442 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.300741 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.300898 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.301046 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.301199 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.301199 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.301484 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.301641 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.301789 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.301942 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.302180 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.302337 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.302337 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.302630 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.302776 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.302929 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.303076 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.303227 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.303382 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.303536 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.303690 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.303837 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.303983 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.304146 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.304331 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.304331 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.304629 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.304782 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.304937 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.305084 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.305351 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.305351 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.305647 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.305795 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.305948 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.306110 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.306269 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.306269 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.306547 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.306693 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.306853 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.307009 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.307157 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.307304 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.307450 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.307595 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.307595 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.307885 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.308040 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.308223 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.308378 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.308378 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.308674 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.308835 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.308835 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.309122 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.309269 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.309269 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.309559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.309715 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.309868 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.310025 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.310171 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.310318 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.310477 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.310631 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.310784 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.310931 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.311076 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.311222 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.311377 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.311525 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.311670 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.311822 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.311990 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.312146 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.312341 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.312452 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.312553 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.312643 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.312738 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.312839 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.312935 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.313019 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.313102 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.313185 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.313268 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.313268 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.313434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.313516 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.313597 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.313687 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.313770 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.313770 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.313938 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.314021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.314103 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.314185 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.314265 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.314355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.314442 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.314572 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.314663 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.314747 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.314834 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.314915 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.314997 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.315081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.315081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.315081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.315081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.315081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.315081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.315081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.315081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.315646 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.315751 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.315991 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.316607 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.316785 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.316936 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.317083 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.317245 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.317396 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.317396 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.317705 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.317853 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.318009 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.318177 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.318338 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.318486 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.318641 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.318796 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.318945 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.319097 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.319251 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.319398 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.319557 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.319754 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.319927 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.320155 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.320155 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.320491 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.320781 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.320961 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.321112 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.321259 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.321406 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.321553 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.321714 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.321875 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.322022 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.322176 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.322323 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.322470 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.322625 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.322781 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.322929 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.323084 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.323231 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.323554 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.323717 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.323874 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.324041 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.324280 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.324447 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.324857 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.325102 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.325374 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.325533 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.325698 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.325854 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.326013 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.326161 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.326317 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.326843 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.327013 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.327171 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.327328 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.327515 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.327675 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.327824 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.327988 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.328148 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.328341 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.328502 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.328651 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.328798 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.328964 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.329123 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.329284 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.329439 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.329586 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.329731 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.329877 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.330032 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.330700 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.330850 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.330850 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.331147 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.331296 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.331463 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.331612 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.331760 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.331907 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.332054 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.332295 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.332463 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.332613 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.332768 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.333053 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.333218 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.333384 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.333532 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.333691 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.333838 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.333838 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.334117 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.334274 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.334424 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.334582 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.334582 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.335152 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.335326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.335604 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.335760 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.335760 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.336053 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.336226 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.336397 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.336971 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.336971 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.337275 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.337431 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.337431 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.337727 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.337884 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.338071 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.338224 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.338224 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.338522 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.338684 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.338684 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.339013 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.339168 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.339324 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.339482 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.339482 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.339774 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.339920 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.339920 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.340270 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.340443 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.340594 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.340742 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.340742 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.341025 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.341180 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.341341 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.341498 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.341498 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.341780 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.341933 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.341933 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.342235 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.342382 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.342382 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.342382 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.342801 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.342963 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.343112 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.343267 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.343414 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.343562 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.343717 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.343883 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.344050 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.344216 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.344371 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.344519 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.344678 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.344949 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.345301 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.345459 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.345776 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.346465 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.346630 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.347275 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.347436 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.347594 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.347594 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.347886 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.348044 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.348044 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.348394 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.348554 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.348710 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.348873 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.348873 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.349172 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.349328 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.349328 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.349621 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.352128 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.352333 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.352503 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.352503 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.352814 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.352964 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.352964 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.353259 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.353407 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.353407 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.353709 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.353872 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.354021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.354168 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.354168 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.354473 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.354629 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.354629 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.354943 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.355218 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.355218 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.355833 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.356124 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.356369 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.356570 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.356570 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.357401 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.357561 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.357561 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.357869 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.358019 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.358019 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.358299 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.358446 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.358605 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.358766 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.358915 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.359063 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.359217 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.359384 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.359594 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.359747 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.359895 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.360051 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.360222 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.360390 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.360390 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.360699 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.360849 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.361004 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.361153 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.361308 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.361504 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.361504 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.362126 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.362293 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.362449 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.362608 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.362608 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.362608 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.362608 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.363178 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.363326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.363488 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.363644 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.363644 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.363926 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.364081 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.364081 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.364419 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.364568 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.364727 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.364883 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.364883 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.365210 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.365494 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.365494 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.365992 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.366168 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.366168 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.366680 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.366842 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.367017 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.367797 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.367797 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.368096 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.368293 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.368524 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.368686 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.368835 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.368984 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.368984 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.369295 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.369444 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.369592 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.369744 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.369744 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.370035 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.370196 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.370351 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.370508 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.370657 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.370811 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.370973 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.371123 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.371123 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.371123 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.371543 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.371692 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.371692 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.371987 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.372147 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.372318 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.372467 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.372627 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.372788 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.372937 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.373084 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.373232 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.373379 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.373548 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.373548 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.373830 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.373994 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.373994 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.374285 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.374509 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.374509 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.374804 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.375033 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.375033 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.375341 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.375518 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.375936 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.376099 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.376099 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.376439 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.376729 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.376892 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.377093 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.377093 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.377994 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.378149 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.378149 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.378444 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.378591 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.378738 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.378885 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.378885 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.379196 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.379358 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.379358 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.379641 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.379800 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.379800 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.380092 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.380288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.380288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.380587 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.380743 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.380743 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.381052 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.381207 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.381207 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.381503 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.381659 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.381819 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.381977 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.381977 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.382274 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.382429 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.382577 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.382734 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.382734 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.383032 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.383179 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.383326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.383485 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.383643 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.383791 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.383945 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.384095 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.384260 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.384428 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.384577 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.384733 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.385541 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.385704 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.386093 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.386250 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.386412 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.386412 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.386737 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.387021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.387021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.387351 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.387890 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.387890 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.388662 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.388824 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.388824 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.389116 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.389273 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.389435 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.389593 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.389593 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.389873 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.390029 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.390189 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.390345 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.390501 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.390656 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.390656 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.390946 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.391095 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.391095 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.391396 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.391559 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.391708 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.391860 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.391860 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.392173 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.392441 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.393246 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.393417 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.393417 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.393709 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.393859 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.393859 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.394156 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.394422 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.394422 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.394735 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.394893 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.395061 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.395212 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.395212 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.395515 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.395673 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.395823 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.395995 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.396465 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.396624 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.396773 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.396950 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.397256 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.397424 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.397590 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.398152 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.398549 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.398705 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.398855 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.399002 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.399150 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.399297 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.399455 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.399604 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.399751 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.399897 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.400056 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.400230 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.400398 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.400558 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.400707 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.400854 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.401008 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.401163 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.401320 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.401470 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.401624 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.401780 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.401938 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.402100 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.402258 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.402414 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.402571 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.402719 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.402880 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.403043 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.403200 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.403349 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.403509 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.403658 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.403804 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.403975 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.404124 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.404321 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.404481 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.404638 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.404796 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.404952 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.405107 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.405274 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.405532 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.405688 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.405845 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.406009 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.406009 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.406308 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.406645 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.406810 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.406979 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.407134 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.407290 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.407451 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.407704 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.407885 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.409225 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.409390 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.409561 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.409718 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.409875 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.410037 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.410192 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.410347 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.410503 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.410651 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.410799 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.410958 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.411108 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.411262 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.411418 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.411582 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 03:38:38.411732 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.411732 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.411732 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.411732 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.411732 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.411732 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.411732 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.411732 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.412889 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.412889 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.412889 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.412889 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.413477 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.413477 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.413765 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.413986 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.414297 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.414615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.414922 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.421664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.421664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.421664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.421664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.421664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.421664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.421664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.421664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.423355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.423355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.423355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:38:38.423355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 03:38:38.526449 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_db.sqlalchemy.engines [None req-0054e06e-2a5f-4639-b9a1-a9fd2c7b827e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:38:38.533958 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_db.sqlalchemy.engines [None req-872a78d9-0666-47c0-aaf0-d47829ffa149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:38:38.608857 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.context [None req-0054e06e-2a5f-4639-b9a1-a9fd2c7b827e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c015e818-e9f7-45c5-a54b-4b6aaf8bfd26(cell1) {{(pid=108440) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 03:38:38.612637 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.context [None req-872a78d9-0666-47c0-aaf0-d47829ffa149 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c015e818-e9f7-45c5-a54b-4b6aaf8bfd26(cell1) {{(pid=108439) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 03:38:38.613376 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0054e06e-2a5f-4639-b9a1-a9fd2c7b827e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:38:38.614999 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0054e06e-2a5f-4639-b9a1-a9fd2c7b827e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:38:38.615825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0054e06e-2a5f-4639-b9a1-a9fd2c7b827e None None] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:38:38.616841 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-872a78d9-0666-47c0-aaf0-d47829ffa149 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:38:38.617818 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0054e06e-2a5f-4639-b9a1-a9fd2c7b827e None None] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:38:38.618590 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-872a78d9-0666-47c0-aaf0-d47829ffa149 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:38:38.619401 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-872a78d9-0666-47c0-aaf0-d47829ffa149 None None] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:38:38.621485 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-872a78d9-0666-47c0-aaf0-d47829ffa149 None None] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:38:38.629666 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_db.sqlalchemy.engines [None req-0054e06e-2a5f-4639-b9a1-a9fd2c7b827e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:38:38.631568 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_db.sqlalchemy.engines [None req-0054e06e-2a5f-4639-b9a1-a9fd2c7b827e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:38:38.632993 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_db.sqlalchemy.engines [None req-872a78d9-0666-47c0-aaf0-d47829ffa149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:38:38.634443 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_db.sqlalchemy.engines [None req-872a78d9-0666-47c0-aaf0-d47829ffa149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:38:38.903904 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_db.sqlalchemy.engines [None req-0054e06e-2a5f-4639-b9a1-a9fd2c7b827e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:38:38.906093 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_db.sqlalchemy.engines [None req-872a78d9-0666-47c0-aaf0-d47829ffa149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:38:39.231789 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: WARNING keystonemiddleware.auth_token [None req-872a78d9-0666-47c0-aaf0-d47829ffa149 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 03:38:39.238997 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: WARNING keystonemiddleware.auth_token [None req-872a78d9-0666-47c0-aaf0-d47829ffa149 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 03:38:39.240223 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: WARNING keystonemiddleware.auth_token [None req-0054e06e-2a5f-4639-b9a1-a9fd2c7b827e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 03:38:39.246778 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: WARNING keystonemiddleware.auth_token [None req-0054e06e-2a5f-4639-b9a1-a9fd2c7b827e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 03:38:39.585269 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: WARNING keystonemiddleware.auth_token [None req-872a78d9-0666-47c0-aaf0-d47829ffa149 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 03:38:39.589796 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: WARNING keystonemiddleware.auth_token [None req-0054e06e-2a5f-4639-b9a1-a9fd2c7b827e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 03:38:39.590468 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: WARNING keystonemiddleware.auth_token [None req-872a78d9-0666-47c0-aaf0-d47829ffa149 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 03:38:39.595068 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: WARNING keystonemiddleware.auth_token [None req-0054e06e-2a5f-4639-b9a1-a9fd2c7b827e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 03:38:39.595580 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5636404f89c0 pid: 108439 (default app) Aug 10 03:38:39.600786 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5636404f89c0 pid: 108440 (default app) Aug 10 03:39:15.359930 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-045f4256-3ad0-4e31-bec5-aa49aae2c669 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] Action: 'create', calling method: .version_select at 0x7f97a204d4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-539287396", "metadata": {"Type": "work"}}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:15.361881 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-045f4256-3ad0-4e31-bec5-aa49aae2c669 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:39:15.363339 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-045f4256-3ad0-4e31-bec5-aa49aae2c669 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.642529 Aug 10 03:39:15.363902 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 1/1] 10.222.0.21 () {60 vars in 1156 bytes} [Tue Aug 10 03:39:14 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 645 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 03:39:15.580765 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-78b5640a-043b-4d87-889d-d054c0c5ba1b tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] Action: 'create', calling method: .version_select at 0x7f97a20970d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2104784564", "metadata": {"Type": "work"}}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:15.589170 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-78b5640a-043b-4d87-889d-d054c0c5ba1b tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:39:15.589170 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-78b5640a-043b-4d87-889d-d054c0c5ba1b tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.213115 Aug 10 03:39:15.589170 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 1/2] 10.222.0.21 () {60 vars in 1156 bytes} [Tue Aug 10 03:39:15 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 03:39:15.596026 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-237e4360-28fa-4c69-a0b6-25b8b692a23a tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] Action: 'create', calling method: .version_select at 0x7f97a1fde0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-126501726", "metadata": {"Type": "work"}}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:15.597661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-237e4360-28fa-4c69-a0b6-25b8b692a23a tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:39:15.598816 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-237e4360-28fa-4c69-a0b6-25b8b692a23a tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008277 Aug 10 03:39:15.599814 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 2/3] 10.222.0.21 () {60 vars in 1156 bytes} [Tue Aug 10 03:39:15 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 03:39:15.611242 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-82ef003a-cd58-4fdd-adfa-7633f9564c12 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] Calling method '.version_select at 0x7f97a2097d30>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:16.082915 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-82ef003a-cd58-4fdd-adfa-7633f9564c12 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] HTTP exception thrown: Volume tempest-invalid-544130668 could not be found. Aug 10 03:39:16.083665 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-82ef003a-cd58-4fdd-adfa-7633f9564c12 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] Returning 404 to user: Volume tempest-invalid-544130668 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:39:16.084627 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-82ef003a-cd58-4fdd-adfa-7633f9564c12 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/tempest-invalid-544130668" status: 404 len: 98 microversion: 2.1 time: 0.479432 Aug 10 03:39:16.085802 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 2/4] 10.222.0.21 () {58 vars in 1215 bytes} [Tue Aug 10 03:39:15 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-544130668 => generated 98 bytes in 481 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 03:39:16.104494 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-30f2f46d-5261-4cca-919a-089b60d9d55a tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005432 Aug 10 03:39:16.105526 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 3/5] 10.222.0.21 () {58 vars in 1140 bytes} [Tue Aug 10 03:39:16 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 03:39:16.115710 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e5723dee-832a-48e5-bb7d-728715365fe0 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004902 Aug 10 03:39:16.116356 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 3/6] 10.222.0.21 () {58 vars in 1137 bytes} [Tue Aug 10 03:39:16 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 10 03:39:16.125379 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b3e90aaf-1229-4b29-b147-d537c0f41768 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] Calling method '.version_select at 0x7f97a204db80>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:16.384014 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-b3e90aaf-1229-4b29-b147-d537c0f41768 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] HTTP exception thrown: Volume c4ee4e61-9763-4eb3-ab6d-f24e4ac980f4 could not be found. Aug 10 03:39:16.385580 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b3e90aaf-1229-4b29-b147-d537c0f41768 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] Returning 404 to user: Volume c4ee4e61-9763-4eb3-ab6d-f24e4ac980f4 could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:39:16.386921 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b3e90aaf-1229-4b29-b147-d537c0f41768 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/c4ee4e61-9763-4eb3-ab6d-f24e4ac980f4" status: 404 len: 109 microversion: 2.1 time: 0.265358 Aug 10 03:39:16.387710 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 4/7] 10.222.0.21 () {58 vars in 1248 bytes} [Tue Aug 10 03:39:16 2021] DELETE /compute/v2.1/os-volumes/c4ee4e61-9763-4eb3-ab6d-f24e4ac980f4 => generated 109 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:39:16.397524 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-bc7d97c2-3717-4b87-b8d7-f8621cfffa31 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] Calling method '.version_select at 0x7f97a1f1b550>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:16.430129 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-bc7d97c2-3717-4b87-b8d7-f8621cfffa31 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] HTTP exception thrown: Volume 83c7b614-8a08-4f2c-a652-83aaf3bdbe45 could not be found. Aug 10 03:39:16.430971 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-bc7d97c2-3717-4b87-b8d7-f8621cfffa31 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] Returning 404 to user: Volume 83c7b614-8a08-4f2c-a652-83aaf3bdbe45 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:39:16.432271 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-bc7d97c2-3717-4b87-b8d7-f8621cfffa31 tempest-VolumesNegativeTest-233561212 tempest-VolumesNegativeTest-233561212-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/83c7b614-8a08-4f2c-a652-83aaf3bdbe45" status: 404 len: 109 microversion: 2.1 time: 0.038365 Aug 10 03:39:16.432978 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 4/8] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:39:16 2021] GET /compute/v2.1/os-volumes/83c7b614-8a08-4f2c-a652-83aaf3bdbe45 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:39:16.560784 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1118268962", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452", "networks": [{"uuid": "e8b067fe-e48c-4956-b622-94dc11656b27"}]}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:16.684355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.network.neutron [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] validate_networks() for [('e8b067fe-e48c-4956-b622-94dc11656b27', None, None, None)] {{(pid=108439) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:39:17.778212 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Flavor limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:39:17.779388 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Image limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:39:17.780155 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Flavor pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:39:17.780790 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Image pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:39:17.781232 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:39:17.796326 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:17.796705 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:17.797517 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:17.798165 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:17.836562 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Getting quotas for project 02cb87684af34e389239670bfe0eb2af. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:39:17.852032 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Getting quotas for user 09b063b3c1f344f5818b55f29b349571 and project 02cb87684af34e389239670bfe0eb2af. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:39:17.864006 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Going to run 1 instances... {{(pid=108439) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:39:17.870286 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:39:18.064853 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f8240c25-fd0a-4e48-b402-b57c412d2686 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.594434 Aug 10 03:39:18.068870 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 5/9] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:39:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 03:39:18.077247 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ef2e654a-0102-4c26-95e3-040f2eed9d88 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:18.078078 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ef2e654a-0102-4c26-95e3-040f2eed9d88 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:18.211432 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ef2e654a-0102-4c26-95e3-040f2eed9d88 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:18.261042 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ef2e654a-0102-4c26-95e3-040f2eed9d88 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1215 microversion: 2.1 time: 0.186445 Aug 10 03:39:18.262992 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 5/10] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:18 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1215 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:19.281416 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1f0e9e0f-63ab-4b33-8beb-b7f2791be029 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:19.282634 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1f0e9e0f-63ab-4b33-8beb-b7f2791be029 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:19.429303 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1f0e9e0f-63ab-4b33-8beb-b7f2791be029 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:19.450142 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1f0e9e0f-63ab-4b33-8beb-b7f2791be029 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1215 microversion: 2.1 time: 0.167427 Aug 10 03:39:19.450142 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 6/11] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:19 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1215 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:20.143034 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1120529535", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452", "networks": [{"uuid": "05518596-49b6-4e96-8053-0b4e84949d5e"}]}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:20.253175 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.network.neutron [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] validate_networks() for [('05518596-49b6-4e96-8053-0b4e84949d5e', None, None, None)] {{(pid=108440) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:39:20.463993 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-614a0565-bf22-40df-8e10-56f8e72be37f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:20.464639 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-614a0565-bf22-40df-8e10-56f8e72be37f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:20.806846 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-614a0565-bf22-40df-8e10-56f8e72be37f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:20.814802 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-614a0565-bf22-40df-8e10-56f8e72be37f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1215 microversion: 2.1 time: 0.353348 Aug 10 03:39:20.827536 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 7/12] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:20 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1215 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:21.469694 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Flavor limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:39:21.471261 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Image limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:39:21.471852 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Flavor pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:39:21.472402 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Image pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:39:21.473077 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:39:21.487102 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:21.487681 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:21.488837 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:21.489381 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:21.519800 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Getting quotas for project 0218bd23bab4457abfb072f168e61af6. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:39:21.526606 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Getting quotas for user cb4a0eaef1ba4df5a07bda5bef95dd99 and project 0218bd23bab4457abfb072f168e61af6. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:39:21.538392 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Going to run 1 instances... {{(pid=108440) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:39:21.541407 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:39:21.797943 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-420db6bc-fbcb-4944-9a33-8f19028dbfab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.927416 Aug 10 03:39:21.801414 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 6/13] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:39:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 1934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 03:39:21.809958 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-4498c766-c25e-45d5-a185-6b58b78ce8e1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:21.810569 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-4498c766-c25e-45d5-a185-6b58b78ce8e1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:21.838069 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-143c84cf-c430-4343-9892-c43500d02c68 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:21.839775 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-143c84cf-c430-4343-9892-c43500d02c68 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:21.851761 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-143c84cf-c430-4343-9892-c43500d02c68 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:21.853330 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-143c84cf-c430-4343-9892-c43500d02c68 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:21.854397 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-143c84cf-c430-4343-9892-c43500d02c68 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:21.855165 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-143c84cf-c430-4343-9892-c43500d02c68 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:22.037349 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4498c766-c25e-45d5-a185-6b58b78ce8e1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:22.046525 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-4498c766-c25e-45d5-a185-6b58b78ce8e1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1218 microversion: 2.1 time: 0.238000 Aug 10 03:39:22.052662 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 8/14] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:21 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1218 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:22.305006 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-143c84cf-c430-4343-9892-c43500d02c68 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:22.338374 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-143c84cf-c430-4343-9892-c43500d02c68 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1211 microversion: 2.1 time: 0.506890 Aug 10 03:39:22.346397 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 7/15] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:21 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1211 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:23.062964 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b6eeed3a-15a3-4f38-8659-c16868bbbdd3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:23.063588 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b6eeed3a-15a3-4f38-8659-c16868bbbdd3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:23.317321 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b6eeed3a-15a3-4f38-8659-c16868bbbdd3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:23.336354 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b6eeed3a-15a3-4f38-8659-c16868bbbdd3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1218 microversion: 2.1 time: 0.267094 Aug 10 03:39:23.338139 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 9/16] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:23 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1218 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:23.365971 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d51eeafe-b307-4ad2-8c4a-4313874b1a0f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:23.367258 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d51eeafe-b307-4ad2-8c4a-4313874b1a0f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:23.379454 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d51eeafe-b307-4ad2-8c4a-4313874b1a0f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:23.381455 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d51eeafe-b307-4ad2-8c4a-4313874b1a0f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:23.383928 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d51eeafe-b307-4ad2-8c4a-4313874b1a0f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:23.384650 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d51eeafe-b307-4ad2-8c4a-4313874b1a0f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:23.738657 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d51eeafe-b307-4ad2-8c4a-4313874b1a0f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:23.753351 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d51eeafe-b307-4ad2-8c4a-4313874b1a0f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1275 microversion: 2.1 time: 0.394123 Aug 10 03:39:23.761922 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 8/17] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:23 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1275 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:24.354707 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-902e7b2b-d2db-4a72-a264-e370bf8e9c2c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:24.355563 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-902e7b2b-d2db-4a72-a264-e370bf8e9c2c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:24.367271 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-902e7b2b-d2db-4a72-a264-e370bf8e9c2c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:24.369914 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-902e7b2b-d2db-4a72-a264-e370bf8e9c2c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:24.369914 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-902e7b2b-d2db-4a72-a264-e370bf8e9c2c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:24.369914 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-902e7b2b-d2db-4a72-a264-e370bf8e9c2c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:24.777820 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d8e656aa-6ccb-4c3c-be0d-fa84c94ef68f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:24.778489 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d8e656aa-6ccb-4c3c-be0d-fa84c94ef68f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:24.795738 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d8e656aa-6ccb-4c3c-be0d-fa84c94ef68f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:24.796251 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d8e656aa-6ccb-4c3c-be0d-fa84c94ef68f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:24.797212 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d8e656aa-6ccb-4c3c-be0d-fa84c94ef68f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:24.797659 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d8e656aa-6ccb-4c3c-be0d-fa84c94ef68f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:24.881195 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-902e7b2b-d2db-4a72-a264-e370bf8e9c2c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:24.897796 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-902e7b2b-d2db-4a72-a264-e370bf8e9c2c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1222 microversion: 2.1 time: 0.547096 Aug 10 03:39:24.909066 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 10/18] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:24 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1222 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:24.950988 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d8e656aa-6ccb-4c3c-be0d-fa84c94ef68f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:24.962541 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d8e656aa-6ccb-4c3c-be0d-fa84c94ef68f tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1273 microversion: 2.1 time: 0.191591 Aug 10 03:39:24.964145 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 9/19] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:24 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1273 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:25.925885 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-92039034-afa5-4ea1-8fea-9816ca34376c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:25.927710 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-92039034-afa5-4ea1-8fea-9816ca34376c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:25.935871 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-92039034-afa5-4ea1-8fea-9816ca34376c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:25.936449 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-92039034-afa5-4ea1-8fea-9816ca34376c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:25.937795 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-92039034-afa5-4ea1-8fea-9816ca34376c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:25.938526 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-92039034-afa5-4ea1-8fea-9816ca34376c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:25.982406 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a750df96-3395-430b-975a-8e569c7516b4 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:25.984382 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a750df96-3395-430b-975a-8e569c7516b4 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:25.991525 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a750df96-3395-430b-975a-8e569c7516b4 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:25.992101 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a750df96-3395-430b-975a-8e569c7516b4 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:25.993519 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a750df96-3395-430b-975a-8e569c7516b4 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:25.994157 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a750df96-3395-430b-975a-8e569c7516b4 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:26.016291 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-92039034-afa5-4ea1-8fea-9816ca34376c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:26.029882 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-92039034-afa5-4ea1-8fea-9816ca34376c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1222 microversion: 2.1 time: 0.108239 Aug 10 03:39:26.030996 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 11/20] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:25 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:26.122236 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a750df96-3395-430b-975a-8e569c7516b4 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:26.129602 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a750df96-3395-430b-975a-8e569c7516b4 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1273 microversion: 2.1 time: 0.151182 Aug 10 03:39:26.130163 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 10/21] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:25 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:27.048873 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-12457820-dd98-485d-8b38-cc26d3ee054c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:27.049979 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-12457820-dd98-485d-8b38-cc26d3ee054c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:27.062377 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-12457820-dd98-485d-8b38-cc26d3ee054c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:27.062851 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-12457820-dd98-485d-8b38-cc26d3ee054c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:27.068367 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-12457820-dd98-485d-8b38-cc26d3ee054c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:27.069191 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-12457820-dd98-485d-8b38-cc26d3ee054c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:27.147162 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-099ca426-aec7-42b8-8ad8-568f2baa1044 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:27.147768 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-099ca426-aec7-42b8-8ad8-568f2baa1044 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:27.155207 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-099ca426-aec7-42b8-8ad8-568f2baa1044 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:27.155751 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-099ca426-aec7-42b8-8ad8-568f2baa1044 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:27.159379 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-099ca426-aec7-42b8-8ad8-568f2baa1044 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:27.160219 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-099ca426-aec7-42b8-8ad8-568f2baa1044 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:27.163166 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-12457820-dd98-485d-8b38-cc26d3ee054c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:27.178926 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-12457820-dd98-485d-8b38-cc26d3ee054c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1222 microversion: 2.1 time: 0.128858 Aug 10 03:39:27.185213 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 12/22] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:27 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1222 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:27.462787 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-099ca426-aec7-42b8-8ad8-568f2baa1044 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:27.474902 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-099ca426-aec7-42b8-8ad8-568f2baa1044 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1315 microversion: 2.1 time: 0.331424 Aug 10 03:39:27.482971 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 11/23] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:27 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:28.514562 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ee4aed9d-2bbc-488a-80cc-cd3c83a47425 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:28.514562 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ee4aed9d-2bbc-488a-80cc-cd3c83a47425 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:28.514562 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ee4aed9d-2bbc-488a-80cc-cd3c83a47425 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:28.514562 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ee4aed9d-2bbc-488a-80cc-cd3c83a47425 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:28.519973 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ee4aed9d-2bbc-488a-80cc-cd3c83a47425 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:28.519973 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ee4aed9d-2bbc-488a-80cc-cd3c83a47425 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:28.643797 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ee4aed9d-2bbc-488a-80cc-cd3c83a47425 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:28.653204 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ee4aed9d-2bbc-488a-80cc-cd3c83a47425 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1222 microversion: 2.1 time: 0.455028 Aug 10 03:39:28.662786 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 13/24] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:28 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1222 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:28.681059 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0fd43baa-cdce-4c56-93f3-b69172cc27f5 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:28.691364 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0fd43baa-cdce-4c56-93f3-b69172cc27f5 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:28.698339 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1affa7a3-8986-4114-a98c-cbb0517b28dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'create', calling method: .version_select at 0x7f97a1f1b040>, body: {"keypair": {"name": "tempest-keypair-1970662002"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:28.719210 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0fd43baa-cdce-4c56-93f3-b69172cc27f5 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:28.720053 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0fd43baa-cdce-4c56-93f3-b69172cc27f5 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:28.723216 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0fd43baa-cdce-4c56-93f3-b69172cc27f5 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:28.730892 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0fd43baa-cdce-4c56-93f3-b69172cc27f5 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:28.820949 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-1affa7a3-8986-4114-a98c-cbb0517b28dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Getting quotas for project 098d020e6c2a497a939e7c54eb5cc81a. Resources: {'key_pairs'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:39:28.860274 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-1affa7a3-8986-4114-a98c-cbb0517b28dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Getting quotas for user 84e7b0c8858f4616ad809fb025ffa9ff and project 098d020e6c2a497a939e7c54eb5cc81a. Resources: {'key_pairs'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:39:29.352489 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0fd43baa-cdce-4c56-93f3-b69172cc27f5 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:29.352489 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0fd43baa-cdce-4c56-93f3-b69172cc27f5 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1315 microversion: 2.1 time: 0.664741 Aug 10 03:39:29.352489 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 14/25] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:28 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:29.518275 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-1affa7a3-8986-4114-a98c-cbb0517b28dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Getting quotas for project 098d020e6c2a497a939e7c54eb5cc81a. Resources: {'key_pairs'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:39:29.532716 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-1affa7a3-8986-4114-a98c-cbb0517b28dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Getting quotas for user 84e7b0c8858f4616ad809fb025ffa9ff and project 098d020e6c2a497a939e7c54eb5cc81a. Resources: {'key_pairs'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:39:29.559555 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1affa7a3-8986-4114-a98c-cbb0517b28dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.124132 Aug 10 03:39:29.560739 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 12/26] 10.222.0.21 () {62 vars in 1199 bytes} [Tue Aug 10 03:39:28 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1126 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 10 03:39:29.676460 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0943a5ef-4efa-4bb7-a5c9-ed932bd0b500 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:29.677124 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0943a5ef-4efa-4bb7-a5c9-ed932bd0b500 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:29.696961 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0943a5ef-4efa-4bb7-a5c9-ed932bd0b500 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:29.698317 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0943a5ef-4efa-4bb7-a5c9-ed932bd0b500 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:29.699614 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0943a5ef-4efa-4bb7-a5c9-ed932bd0b500 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:29.700266 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0943a5ef-4efa-4bb7-a5c9-ed932bd0b500 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:30.080410 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0943a5ef-4efa-4bb7-a5c9-ed932bd0b500 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:30.100980 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0943a5ef-4efa-4bb7-a5c9-ed932bd0b500 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1270 microversion: 2.1 time: 0.428705 Aug 10 03:39:30.121453 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 15/27] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:29 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1270 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:30.359053 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-670055af-0ccc-4793-aead-ab27dba195c9 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:30.366092 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-670055af-0ccc-4793-aead-ab27dba195c9 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:30.369772 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-670055af-0ccc-4793-aead-ab27dba195c9 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:30.370222 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-670055af-0ccc-4793-aead-ab27dba195c9 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:30.371011 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-670055af-0ccc-4793-aead-ab27dba195c9 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:30.377413 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-670055af-0ccc-4793-aead-ab27dba195c9 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:31.135256 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-356a90bc-9f70-4109-bfa4-490b0062b2c4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:31.136631 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-356a90bc-9f70-4109-bfa4-490b0062b2c4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:31.144380 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-356a90bc-9f70-4109-bfa4-490b0062b2c4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:31.155999 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-356a90bc-9f70-4109-bfa4-490b0062b2c4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:31.172677 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-356a90bc-9f70-4109-bfa4-490b0062b2c4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:31.177039 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-356a90bc-9f70-4109-bfa4-490b0062b2c4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:31.592629 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-356a90bc-9f70-4109-bfa4-490b0062b2c4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:31.609116 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-356a90bc-9f70-4109-bfa4-490b0062b2c4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1288 microversion: 2.1 time: 0.475661 Aug 10 03:39:31.622276 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 16/28] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:31 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1288 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:32.207448 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-670055af-0ccc-4793-aead-ab27dba195c9 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:32.235190 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-670055af-0ccc-4793-aead-ab27dba195c9 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1315 microversion: 2.1 time: 1.879787 Aug 10 03:39:32.236141 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 13/29] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:30 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1315 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:32.633970 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-00bc9c9b-addc-419e-b873-30b3ff93bfe6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:32.635341 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-00bc9c9b-addc-419e-b873-30b3ff93bfe6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:32.652630 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-00bc9c9b-addc-419e-b873-30b3ff93bfe6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:32.657886 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-00bc9c9b-addc-419e-b873-30b3ff93bfe6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:32.670879 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-00bc9c9b-addc-419e-b873-30b3ff93bfe6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:32.671488 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-00bc9c9b-addc-419e-b873-30b3ff93bfe6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:33.202545 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-00bc9c9b-addc-419e-b873-30b3ff93bfe6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:33.211079 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-00bc9c9b-addc-419e-b873-30b3ff93bfe6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1276 microversion: 2.1 time: 0.581925 Aug 10 03:39:33.215573 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 17/30] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:32 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1276 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:33.253326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-5748d56e-16f2-4c59-a940-4255d6b68e96 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:33.253933 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-5748d56e-16f2-4c59-a940-4255d6b68e96 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:33.264059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5748d56e-16f2-4c59-a940-4255d6b68e96 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:33.264059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5748d56e-16f2-4c59-a940-4255d6b68e96 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:33.264059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5748d56e-16f2-4c59-a940-4255d6b68e96 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:33.264059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5748d56e-16f2-4c59-a940-4255d6b68e96 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:33.749487 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1858619306", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e937d74f-0feb-4fbb-a381-7b68bdc8a232"}]}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:33.904701 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.network.neutron [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] validate_networks() for [('e937d74f-0feb-4fbb-a381-7b68bdc8a232', None, None, None)] {{(pid=108439) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:39:34.502729 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-5748d56e-16f2-4c59-a940-4255d6b68e96 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:34.520474 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-5748d56e-16f2-4c59-a940-4255d6b68e96 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1315 microversion: 2.1 time: 1.270519 Aug 10 03:39:34.525791 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 14/31] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:33 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1315 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:34.540090 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8d70ddd1-d4f4-4dcf-8985-b0b4e4e4e793 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:34.551718 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8d70ddd1-d4f4-4dcf-8985-b0b4e4e4e793 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:34.569807 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8d70ddd1-d4f4-4dcf-8985-b0b4e4e4e793 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:34.572501 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8d70ddd1-d4f4-4dcf-8985-b0b4e4e4e793 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:34.575864 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8d70ddd1-d4f4-4dcf-8985-b0b4e4e4e793 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:34.577288 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8d70ddd1-d4f4-4dcf-8985-b0b4e4e4e793 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:35.446585 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-8d70ddd1-d4f4-4dcf-8985-b0b4e4e4e793 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:35.446585 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8d70ddd1-d4f4-4dcf-8985-b0b4e4e4e793 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1276 microversion: 2.1 time: 0.743552 Aug 10 03:39:35.446585 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 15/32] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:34 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1276 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:35.448074 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Flavor limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:39:35.448074 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Image limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:39:35.448074 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Flavor pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:39:35.448074 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Image pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:39:35.448074 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:39:35.452121 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:35.452121 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:35.452121 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:35.452121 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:35.458571 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Getting quotas for project 05aa352203a74307bd3b6157f78f6b97. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:39:35.458571 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Getting quotas for user f4e6c08307964f198aa7efc7961aa09f and project 05aa352203a74307bd3b6157f78f6b97. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:39:35.458571 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Going to run 1 instances... {{(pid=108439) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:39:35.460231 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:39:35.460509 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-7ee08e61-7179-4f73-aa33-368662c11f0a req-8c1c9f20-035e-4617-b622-4126122ed2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b15c91-649d-46ab-8a83-0af955b0034c", "tag": "de122834-5f01-4a99-9143-529a113b3416"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:35.460509 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:39:35.460509 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:39:35.460509 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-7ee08e61-7179-4f73-aa33-368662c11f0a req-8c1c9f20-035e-4617-b622-4126122ed2b3 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:35.460509 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-7ee08e61-7179-4f73-aa33-368662c11f0a req-8c1c9f20-035e-4617-b622-4126122ed2b3 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:35.486455 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-7ee08e61-7179-4f73-aa33-368662c11f0a req-8c1c9f20-035e-4617-b622-4126122ed2b3 service nova] Creating event network-changed:de122834-5f01-4a99-9143-529a113b3416 for instance 11b15c91-649d-46ab-8a83-0af955b0034c on hv-cinder-78239 Aug 10 03:39:35.487027 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-7ee08e61-7179-4f73-aa33-368662c11f0a req-8c1c9f20-035e-4617-b622-4126122ed2b3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 10 03:39:35.491758 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c8ab807b-5a61-4797-9349-1ab3712e9e80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:35.492288 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c8ab807b-5a61-4797-9349-1ab3712e9e80 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:35.495793 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c8ab807b-5a61-4797-9349-1ab3712e9e80 None None] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:35.496265 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c8ab807b-5a61-4797-9349-1ab3712e9e80 None None] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:35.520980 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.compute.rpcapi [None req-c8ab807b-5a61-4797-9349-1ab3712e9e80 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Aug 10 03:39:35.523011 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c8ab807b-5a61-4797-9349-1ab3712e9e80 None None] Releasing lock "compute-rpcapi-router" {{(pid=108440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 10 03:39:35.569740 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c8ab807b-5a61-4797-9349-1ab3712e9e80 None None] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295800 Aug 10 03:39:35.572075 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 16/33] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:39:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:39:35.591671 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4a489483-b872-4d13-9b3f-edc18c4ec558 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:35.593839 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4a489483-b872-4d13-9b3f-edc18c4ec558 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:35.610427 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4a489483-b872-4d13-9b3f-edc18c4ec558 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:35.610869 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4a489483-b872-4d13-9b3f-edc18c4ec558 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:35.613772 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4a489483-b872-4d13-9b3f-edc18c4ec558 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:35.617268 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4a489483-b872-4d13-9b3f-edc18c4ec558 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:35.890265 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-4a489483-b872-4d13-9b3f-edc18c4ec558 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:35.898952 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4a489483-b872-4d13-9b3f-edc18c4ec558 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1315 microversion: 2.1 time: 0.324102 Aug 10 03:39:35.908426 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 17/34] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:35 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:36.446243 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a56fe2eb-42db-4235-9eec-81057bc64219 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:36.446944 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a56fe2eb-42db-4235-9eec-81057bc64219 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:36.453118 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a56fe2eb-42db-4235-9eec-81057bc64219 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:36.459728 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a56fe2eb-42db-4235-9eec-81057bc64219 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:36.459728 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a56fe2eb-42db-4235-9eec-81057bc64219 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:36.459728 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a56fe2eb-42db-4235-9eec-81057bc64219 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:36.526679 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a56fe2eb-42db-4235-9eec-81057bc64219 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:36.530847 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a56fe2eb-42db-4235-9eec-81057bc64219 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1276 microversion: 2.1 time: 0.089294 Aug 10 03:39:36.532161 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 18/35] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:36 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:36.644705 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-efc2ab1a-36e2-4f11-ac74-82f4be54077c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.331390 Aug 10 03:39:36.656879 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 18/36] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:39:33 2021] POST /compute/v2.1/servers => generated 383 bytes in 3338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 03:39:36.661499 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-07521b8b-16a7-48e8-b934-2844eb160533 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:36.662221 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-07521b8b-16a7-48e8-b934-2844eb160533 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:36.918629 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1d2d05ec-74b7-4741-9ca4-d5f944ab6435 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:36.919867 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1d2d05ec-74b7-4741-9ca4-d5f944ab6435 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:36.928089 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1d2d05ec-74b7-4741-9ca4-d5f944ab6435 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:36.931552 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1d2d05ec-74b7-4741-9ca4-d5f944ab6435 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:36.932451 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1d2d05ec-74b7-4741-9ca4-d5f944ab6435 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:36.934134 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1d2d05ec-74b7-4741-9ca4-d5f944ab6435 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:37.001787 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-07521b8b-16a7-48e8-b934-2844eb160533 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:37.001787 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-07521b8b-16a7-48e8-b934-2844eb160533 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1222 microversion: 2.1 time: 0.329846 Aug 10 03:39:37.001787 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 19/37] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:36 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1222 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:37.232340 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1d2d05ec-74b7-4741-9ca4-d5f944ab6435 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:37.240600 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1d2d05ec-74b7-4741-9ca4-d5f944ab6435 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1315 microversion: 2.1 time: 0.326356 Aug 10 03:39:37.241796 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 19/38] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:36 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:37.551418 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0869ad7d-2315-4c34-9715-d779b2d7dcee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:37.556122 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0869ad7d-2315-4c34-9715-d779b2d7dcee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:37.576030 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0869ad7d-2315-4c34-9715-d779b2d7dcee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:37.577914 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0869ad7d-2315-4c34-9715-d779b2d7dcee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:37.580064 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0869ad7d-2315-4c34-9715-d779b2d7dcee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:37.582695 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0869ad7d-2315-4c34-9715-d779b2d7dcee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:38.083593 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0869ad7d-2315-4c34-9715-d779b2d7dcee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:38.091474 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0869ad7d-2315-4c34-9715-d779b2d7dcee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1318 microversion: 2.1 time: 0.547219 Aug 10 03:39:38.093771 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1739281359", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e937d74f-0feb-4fbb-a381-7b68bdc8a232"}]}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:38.094550 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 20/39] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:37 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1318 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:38.205938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.network.neutron [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] validate_networks() for [('e937d74f-0feb-4fbb-a381-7b68bdc8a232', None, None, None)] {{(pid=108439) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:39:38.258247 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-375f6057-b7ef-4491-a9b4-b83fb47aa58b tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:38.258860 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-375f6057-b7ef-4491-a9b4-b83fb47aa58b tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:38.265351 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-375f6057-b7ef-4491-a9b4-b83fb47aa58b tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:38.265712 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-375f6057-b7ef-4491-a9b4-b83fb47aa58b tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:38.266504 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-375f6057-b7ef-4491-a9b4-b83fb47aa58b tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:38.267463 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-375f6057-b7ef-4491-a9b4-b83fb47aa58b tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:39.138903 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Flavor limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:39:39.138903 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Image limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:39:39.138903 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Flavor pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:39:39.138903 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Image pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:39:39.140055 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:39:39.165301 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:39.165772 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:39.166623 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:39.167069 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:39.205988 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Getting quotas for project 05aa352203a74307bd3b6157f78f6b97. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:39:39.220541 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Getting quotas for user f4e6c08307964f198aa7efc7961aa09f and project 05aa352203a74307bd3b6157f78f6b97. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:39:39.261348 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Going to run 1 instances... {{(pid=108439) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:39:39.269131 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:39:39.481623 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-4d7015c3-7f3f-4e61-82bd-a0b808cb0875 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.402086 Aug 10 03:39:39.489733 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 20/40] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:39:38 2021] POST /compute/v2.1/servers => generated 383 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 03:39:39.522196 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-375f6057-b7ef-4491-a9b4-b83fb47aa58b tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:39.546935 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-375f6057-b7ef-4491-a9b4-b83fb47aa58b tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1315 microversion: 2.1 time: 1.292339 Aug 10 03:39:39.558730 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 21/41] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:38 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1315 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:39.590500 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-26774e23-96aa-44ea-80b7-c80a9e21cf95 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:39.593853 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-26774e23-96aa-44ea-80b7-c80a9e21cf95 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:39.611720 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-26774e23-96aa-44ea-80b7-c80a9e21cf95 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:39.612770 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-26774e23-96aa-44ea-80b7-c80a9e21cf95 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:39.613850 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-26774e23-96aa-44ea-80b7-c80a9e21cf95 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:39.614433 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-26774e23-96aa-44ea-80b7-c80a9e21cf95 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:39.763101 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2b569d35-55bd-4bce-8426-7cfb640a8547 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'create', calling method: .version_select at 0x7f97a14c88b0>, body: {"keypair": {"name": "tempest-keypair-2045175388"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:39.849483 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-2b569d35-55bd-4bce-8426-7cfb640a8547 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Getting quotas for project db9e9e54834e4fe682d4305010655be7. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:39:39.858824 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-2b569d35-55bd-4bce-8426-7cfb640a8547 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Getting quotas for user e2a2db05b54e45fba8475e7949a61d6a and project db9e9e54834e4fe682d4305010655be7. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:39:40.560553 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-2b569d35-55bd-4bce-8426-7cfb640a8547 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Getting quotas for project db9e9e54834e4fe682d4305010655be7. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:39:40.571584 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-2b569d35-55bd-4bce-8426-7cfb640a8547 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Getting quotas for user e2a2db05b54e45fba8475e7949a61d6a and project db9e9e54834e4fe682d4305010655be7. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:39:40.593635 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2b569d35-55bd-4bce-8426-7cfb640a8547 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.101632 Aug 10 03:39:40.595550 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 21/42] 10.222.0.21 () {60 vars in 1158 bytes} [Tue Aug 10 03:39:39 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:40.632733 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e7b778a1-bc72-4076-aa5e-6acb55bbf721 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:40.632733 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e7b778a1-bc72-4076-aa5e-6acb55bbf721 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:40.757788 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e7b778a1-bc72-4076-aa5e-6acb55bbf721 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:40.766177 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e7b778a1-bc72-4076-aa5e-6acb55bbf721 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1222 microversion: 2.1 time: 0.169288 Aug 10 03:39:40.767868 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 22/43] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:40 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1222 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:40.776022 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8a088883-a1d9-4780-9501-043242b09d5a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:40.776917 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8a088883-a1d9-4780-9501-043242b09d5a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:40.784819 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8a088883-a1d9-4780-9501-043242b09d5a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:40.785275 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8a088883-a1d9-4780-9501-043242b09d5a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:40.786062 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8a088883-a1d9-4780-9501-043242b09d5a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:40.787229 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8a088883-a1d9-4780-9501-043242b09d5a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:40.930853 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-26774e23-96aa-44ea-80b7-c80a9e21cf95 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:40.950401 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-26774e23-96aa-44ea-80b7-c80a9e21cf95 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1318 microversion: 2.1 time: 1.390379 Aug 10 03:39:40.952915 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 22/44] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:39 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1318 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:41.165349 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8a088883-a1d9-4780-9501-043242b09d5a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:41.188536 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8a088883-a1d9-4780-9501-043242b09d5a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1315 microversion: 2.1 time: 0.418354 Aug 10 03:39:41.194918 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 23/45] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:40 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:41.784574 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a7ff5816-98fb-44fe-9dd7-1af9c9d1a347 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:41.785421 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a7ff5816-98fb-44fe-9dd7-1af9c9d1a347 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:41.951389 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a7ff5816-98fb-44fe-9dd7-1af9c9d1a347 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:41.961890 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a7ff5816-98fb-44fe-9dd7-1af9c9d1a347 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1222 microversion: 2.1 time: 0.181286 Aug 10 03:39:41.963101 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 23/46] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:41 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1222 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:41.977909 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e348adc0-4de1-4c54-ac15-07a3747e29b7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:41.979288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e348adc0-4de1-4c54-ac15-07a3747e29b7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:41.992714 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e348adc0-4de1-4c54-ac15-07a3747e29b7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:41.995377 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e348adc0-4de1-4c54-ac15-07a3747e29b7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:41.998029 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e348adc0-4de1-4c54-ac15-07a3747e29b7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:42.003732 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e348adc0-4de1-4c54-ac15-07a3747e29b7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:42.211348 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-bc234f21-c036-44cc-8309-7f16e5038398 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:42.212050 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-bc234f21-c036-44cc-8309-7f16e5038398 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:42.223703 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bc234f21-c036-44cc-8309-7f16e5038398 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:42.223703 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bc234f21-c036-44cc-8309-7f16e5038398 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:42.223703 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bc234f21-c036-44cc-8309-7f16e5038398 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:42.223991 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bc234f21-c036-44cc-8309-7f16e5038398 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:42.232526 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e348adc0-4de1-4c54-ac15-07a3747e29b7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:42.241769 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e348adc0-4de1-4c54-ac15-07a3747e29b7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1318 microversion: 2.1 time: 0.276599 Aug 10 03:39:42.246285 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 24/47] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:41 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:42.739286 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-bc234f21-c036-44cc-8309-7f16e5038398 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:42.750377 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-bc234f21-c036-44cc-8309-7f16e5038398 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1315 microversion: 2.1 time: 0.542218 Aug 10 03:39:42.764215 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 24/48] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:42 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:42.981966 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-74e2bddc-59ca-42c1-83cd-a0f561f187bd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:42.983549 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-74e2bddc-59ca-42c1-83cd-a0f561f187bd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:42.996355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-74e2bddc-59ca-42c1-83cd-a0f561f187bd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:42.998095 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-74e2bddc-59ca-42c1-83cd-a0f561f187bd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:43.000920 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-74e2bddc-59ca-42c1-83cd-a0f561f187bd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:43.001630 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-74e2bddc-59ca-42c1-83cd-a0f561f187bd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:43.170781 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-1ca5c2b6-cb46-4b84-bd8d-69712bc8d319 req-eca9df28-b58a-49ff-9309-34d940b48890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a912ff3-ac1a-4d82-971a-be7ebb16c176", "tag": "10d027a5-7309-4d2a-a189-a95629488e03"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:43.172583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:39:43.172583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:39:43.188948 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-1ca5c2b6-cb46-4b84-bd8d-69712bc8d319 req-eca9df28-b58a-49ff-9309-34d940b48890 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:43.189295 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-1ca5c2b6-cb46-4b84-bd8d-69712bc8d319 req-eca9df28-b58a-49ff-9309-34d940b48890 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:43.208721 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-1ca5c2b6-cb46-4b84-bd8d-69712bc8d319 req-eca9df28-b58a-49ff-9309-34d940b48890 service nova] Creating event network-changed:10d027a5-7309-4d2a-a189-a95629488e03 for instance 3a912ff3-ac1a-4d82-971a-be7ebb16c176 on hv-cinder-78239 Aug 10 03:39:43.214158 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-74e2bddc-59ca-42c1-83cd-a0f561f187bd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:43.227124 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-74e2bddc-59ca-42c1-83cd-a0f561f187bd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1218 microversion: 2.1 time: 0.250949 Aug 10 03:39:43.240013 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 25/49] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:42 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1218 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:43.245740 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-1ca5c2b6-cb46-4b84-bd8d-69712bc8d319 req-eca9df28-b58a-49ff-9309-34d940b48890 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081477 Aug 10 03:39:43.248579 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 25/50] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:39:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:39:43.267132 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8f0e7501-b0d1-4ecc-9cfb-ffc05412f808 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:43.268086 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8f0e7501-b0d1-4ecc-9cfb-ffc05412f808 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:43.280038 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f0e7501-b0d1-4ecc-9cfb-ffc05412f808 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:43.280948 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f0e7501-b0d1-4ecc-9cfb-ffc05412f808 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:43.282711 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f0e7501-b0d1-4ecc-9cfb-ffc05412f808 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:43.283355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f0e7501-b0d1-4ecc-9cfb-ffc05412f808 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:43.744414 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8f0e7501-b0d1-4ecc-9cfb-ffc05412f808 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:43.753571 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8f0e7501-b0d1-4ecc-9cfb-ffc05412f808 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1318 microversion: 2.1 time: 0.493610 Aug 10 03:39:43.762947 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 26/51] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:43 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:43.781282 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-5f0a78ed-a447-46ef-b4e8-f6c0d4e3892c tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:43.782779 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-5f0a78ed-a447-46ef-b4e8-f6c0d4e3892c tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:43.796565 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5f0a78ed-a447-46ef-b4e8-f6c0d4e3892c tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:43.797021 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5f0a78ed-a447-46ef-b4e8-f6c0d4e3892c tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:43.797880 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5f0a78ed-a447-46ef-b4e8-f6c0d4e3892c tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:43.798316 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5f0a78ed-a447-46ef-b4e8-f6c0d4e3892c tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:44.114655 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-279398141", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8a7c5b76-4670-410e-b09e-14552ce18301"}], "security_groups": [{"name": "tempest-securitygroup--1039130358"}], "key_name": "tempest-keypair-1970662002", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:44.347441 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-5f0a78ed-a447-46ef-b4e8-f6c0d4e3892c tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:44.354887 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-5f0a78ed-a447-46ef-b4e8-f6c0d4e3892c tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1315 microversion: 2.1 time: 0.578099 Aug 10 03:39:44.364689 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 26/52] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:43 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:44.370049 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-72492fca-bfe4-4998-982e-05ae1302fa96 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:44.370841 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-72492fca-bfe4-4998-982e-05ae1302fa96 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:44.394248 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72492fca-bfe4-4998-982e-05ae1302fa96 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:44.394999 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72492fca-bfe4-4998-982e-05ae1302fa96 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:44.408479 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72492fca-bfe4-4998-982e-05ae1302fa96 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:44.408479 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72492fca-bfe4-4998-982e-05ae1302fa96 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:44.427839 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.network.neutron [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] validate_networks() for [('8a7c5b76-4670-410e-b09e-14552ce18301', None, None, None)] {{(pid=108439) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:39:44.582039 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-72492fca-bfe4-4998-982e-05ae1302fa96 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:44.589988 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-72492fca-bfe4-4998-982e-05ae1302fa96 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1292 microversion: 2.1 time: 0.223832 Aug 10 03:39:44.602222 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 27/53] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:44 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1292 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:44.772427 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-86cd964d-6505-423f-8387-2df2a52cc1b1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:44.773393 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-86cd964d-6505-423f-8387-2df2a52cc1b1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:44.782292 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-86cd964d-6505-423f-8387-2df2a52cc1b1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:44.782917 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-86cd964d-6505-423f-8387-2df2a52cc1b1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:44.783962 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-86cd964d-6505-423f-8387-2df2a52cc1b1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:44.784647 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-86cd964d-6505-423f-8387-2df2a52cc1b1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:45.130140 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-86cd964d-6505-423f-8387-2df2a52cc1b1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:45.145638 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-86cd964d-6505-423f-8387-2df2a52cc1b1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1318 microversion: 2.1 time: 0.378697 Aug 10 03:39:45.154944 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 28/54] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:44 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:45.382292 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a7cf105b-f53d-48dd-abf5-c91a49801391 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:45.383022 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a7cf105b-f53d-48dd-abf5-c91a49801391 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:45.389228 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a7cf105b-f53d-48dd-abf5-c91a49801391 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:45.389707 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a7cf105b-f53d-48dd-abf5-c91a49801391 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:45.390911 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a7cf105b-f53d-48dd-abf5-c91a49801391 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:45.391721 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a7cf105b-f53d-48dd-abf5-c91a49801391 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:45.406653 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Flavor limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:39:45.407742 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Image limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:39:45.408073 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Flavor pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:39:45.408693 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Image pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:39:45.409117 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:39:45.419610 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:45.420589 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:45.421702 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:45.422141 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:45.440903 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Getting quotas for project 098d020e6c2a497a939e7c54eb5cc81a. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:39:45.444912 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Getting quotas for user 84e7b0c8858f4616ad809fb025ffa9ff and project 098d020e6c2a497a939e7c54eb5cc81a. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:39:45.456220 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Going to run 1 instances... {{(pid=108439) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:39:45.458473 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:39:45.526429 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a7cf105b-f53d-48dd-abf5-c91a49801391 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:45.534683 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a7cf105b-f53d-48dd-abf5-c91a49801391 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1315 microversion: 2.1 time: 0.156456 Aug 10 03:39:45.540690 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 29/55] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:45 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:45.612424 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8a67eb1e-ddf9-48c2-bd88-67f6e189c4a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:45.616654 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8a67eb1e-ddf9-48c2-bd88-67f6e189c4a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:45.620531 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8a67eb1e-ddf9-48c2-bd88-67f6e189c4a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:45.620995 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8a67eb1e-ddf9-48c2-bd88-67f6e189c4a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:45.621828 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8a67eb1e-ddf9-48c2-bd88-67f6e189c4a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:45.622248 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8a67eb1e-ddf9-48c2-bd88-67f6e189c4a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:45.721330 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-8a67eb1e-ddf9-48c2-bd88-67f6e189c4a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:45.729205 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8a67eb1e-ddf9-48c2-bd88-67f6e189c4a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1280 microversion: 2.1 time: 0.122957 Aug 10 03:39:45.731244 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 30/56] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:45 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1280 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:45.933851 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-76ad5ad9-ada1-4760-b81b-241847b6acf0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.826309 Aug 10 03:39:45.938614 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 27/57] 10.222.0.21 () {62 vars in 1188 bytes} [Tue Aug 10 03:39:44 2021] POST /compute/v2.1/servers => generated 402 bytes in 1832 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 03:39:45.950136 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6076ba74-d068-4b19-8afa-0294eccf6a7d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:45.950929 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6076ba74-d068-4b19-8afa-0294eccf6a7d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:46.029450 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6076ba74-d068-4b19-8afa-0294eccf6a7d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:46.042059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6076ba74-d068-4b19-8afa-0294eccf6a7d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:46.046280 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6076ba74-d068-4b19-8afa-0294eccf6a7d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:46.049127 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6076ba74-d068-4b19-8afa-0294eccf6a7d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1281 microversion: 2.20 time: 0.102964 Aug 10 03:39:46.063987 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 31/58] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:39:45 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1281 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:39:46.166061 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-410e9131-3922-449f-b288-af6fd26da914 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:46.170272 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-410e9131-3922-449f-b288-af6fd26da914 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:46.184251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-410e9131-3922-449f-b288-af6fd26da914 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:46.186857 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-410e9131-3922-449f-b288-af6fd26da914 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:46.187909 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-410e9131-3922-449f-b288-af6fd26da914 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:46.189602 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-410e9131-3922-449f-b288-af6fd26da914 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:46.545965 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-410e9131-3922-449f-b288-af6fd26da914 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:46.551149 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-51336d20-8b5b-4ec8-8b3a-58289ee22835 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:46.551814 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-51336d20-8b5b-4ec8-8b3a-58289ee22835 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:46.559405 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-51336d20-8b5b-4ec8-8b3a-58289ee22835 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:46.569752 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-51336d20-8b5b-4ec8-8b3a-58289ee22835 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:46.569752 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-51336d20-8b5b-4ec8-8b3a-58289ee22835 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:46.569752 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-51336d20-8b5b-4ec8-8b3a-58289ee22835 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:46.575560 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-410e9131-3922-449f-b288-af6fd26da914 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1318 microversion: 2.1 time: 0.414060 Aug 10 03:39:46.577798 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 28/59] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:46 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:46.754405 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-bf247479-0422-4fcd-ae96-1aabdf2fe52e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:46.755503 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-bf247479-0422-4fcd-ae96-1aabdf2fe52e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:46.769835 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bf247479-0422-4fcd-ae96-1aabdf2fe52e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:46.771269 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bf247479-0422-4fcd-ae96-1aabdf2fe52e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:46.774271 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bf247479-0422-4fcd-ae96-1aabdf2fe52e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:46.775659 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bf247479-0422-4fcd-ae96-1aabdf2fe52e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:46.982434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bf247479-0422-4fcd-ae96-1aabdf2fe52e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:46.990362 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-bf247479-0422-4fcd-ae96-1aabdf2fe52e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1322 microversion: 2.1 time: 0.247496 Aug 10 03:39:46.990951 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 29/60] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:46 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:47.067295 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3c4fda11-1032-4177-8abe-b106d184641b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:47.068112 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3c4fda11-1032-4177-8abe-b106d184641b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:47.178052 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3c4fda11-1032-4177-8abe-b106d184641b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:47.185340 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3c4fda11-1032-4177-8abe-b106d184641b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:47.186861 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3c4fda11-1032-4177-8abe-b106d184641b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:47.187948 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3c4fda11-1032-4177-8abe-b106d184641b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1281 microversion: 2.20 time: 0.124899 Aug 10 03:39:47.189624 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 30/61] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:39:47 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1281 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:39:47.235648 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-51336d20-8b5b-4ec8-8b3a-58289ee22835 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:47.243625 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-51336d20-8b5b-4ec8-8b3a-58289ee22835 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1315 microversion: 2.1 time: 0.696674 Aug 10 03:39:47.244210 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 32/62] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:46 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:47.365331 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-839767577", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dcbb3fa8-aa0a-4b07-8830-48ada6a110cb"}], "security_groups": [{"name": "tempest-securitygroup--2126935039"}], "key_name": "tempest-keypair-2045175388", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:47.529144 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.network.neutron [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] validate_networks() for [('dcbb3fa8-aa0a-4b07-8830-48ada6a110cb', None, None, None)] {{(pid=108439) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:39:47.594085 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-59c3b326-e9c8-4dc6-81c4-27396472d681 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:47.594755 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-59c3b326-e9c8-4dc6-81c4-27396472d681 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:47.600905 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-59c3b326-e9c8-4dc6-81c4-27396472d681 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:47.601359 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-59c3b326-e9c8-4dc6-81c4-27396472d681 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:47.602479 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-59c3b326-e9c8-4dc6-81c4-27396472d681 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:47.603085 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-59c3b326-e9c8-4dc6-81c4-27396472d681 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:47.804992 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-59c3b326-e9c8-4dc6-81c4-27396472d681 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:47.818162 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-59c3b326-e9c8-4dc6-81c4-27396472d681 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1318 microversion: 2.1 time: 0.227787 Aug 10 03:39:47.819722 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 33/63] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:47 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:48.006708 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-eecf3fdf-d35a-4542-ad78-f1cf2db6e2bb tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:48.011726 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-eecf3fdf-d35a-4542-ad78-f1cf2db6e2bb tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:48.013716 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-eecf3fdf-d35a-4542-ad78-f1cf2db6e2bb tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:48.014338 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-eecf3fdf-d35a-4542-ad78-f1cf2db6e2bb tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:48.015280 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-eecf3fdf-d35a-4542-ad78-f1cf2db6e2bb tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:48.015881 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-eecf3fdf-d35a-4542-ad78-f1cf2db6e2bb tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:48.238701 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-eecf3fdf-d35a-4542-ad78-f1cf2db6e2bb tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:48.249317 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-eecf3fdf-d35a-4542-ad78-f1cf2db6e2bb tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1322 microversion: 2.1 time: 0.245940 Aug 10 03:39:48.261744 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 34/64] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:48 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:48.267729 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-e7b4a98b-39bd-4827-b798-e4fa678923fb req-70278113-cd9b-4a8b-8d7c-a2ab585b7c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280754b9-5f91-4b9c-a00e-59a052eaab43", "tag": "b8c15eaf-d642-44fa-8a94-a34fbb169d00"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:48.269765 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:39:48.269765 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:39:48.278890 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-e7b4a98b-39bd-4827-b798-e4fa678923fb req-70278113-cd9b-4a8b-8d7c-a2ab585b7c24 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:48.280300 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-e7b4a98b-39bd-4827-b798-e4fa678923fb req-70278113-cd9b-4a8b-8d7c-a2ab585b7c24 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:48.293183 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-e7b4a98b-39bd-4827-b798-e4fa678923fb req-70278113-cd9b-4a8b-8d7c-a2ab585b7c24 service nova] Creating event network-changed:b8c15eaf-d642-44fa-8a94-a34fbb169d00 for instance 280754b9-5f91-4b9c-a00e-59a052eaab43 on hv-cinder-78239 Aug 10 03:39:48.309092 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-e7b4a98b-39bd-4827-b798-e4fa678923fb req-70278113-cd9b-4a8b-8d7c-a2ab585b7c24 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036198 Aug 10 03:39:48.309092 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 35/65] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:39:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:39:48.309092 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b698562d-6d3f-4a25-b1e6-dc2af8c991bb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:48.310543 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b698562d-6d3f-4a25-b1e6-dc2af8c991bb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:48.318440 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b698562d-6d3f-4a25-b1e6-dc2af8c991bb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:48.319081 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b698562d-6d3f-4a25-b1e6-dc2af8c991bb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:48.320043 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b698562d-6d3f-4a25-b1e6-dc2af8c991bb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:48.320775 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b698562d-6d3f-4a25-b1e6-dc2af8c991bb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:48.456976 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b698562d-6d3f-4a25-b1e6-dc2af8c991bb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:48.459024 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b698562d-6d3f-4a25-b1e6-dc2af8c991bb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:48.465380 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b698562d-6d3f-4a25-b1e6-dc2af8c991bb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:48.468246 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b698562d-6d3f-4a25-b1e6-dc2af8c991bb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1285 microversion: 2.20 time: 0.161929 Aug 10 03:39:48.470392 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 36/66] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:39:48 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:39:48.481825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-9d3c3292-2110-49ad-9896-9e91ae5fd869 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:48.483158 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-9d3c3292-2110-49ad-9896-9e91ae5fd869 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:48.497582 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9d3c3292-2110-49ad-9896-9e91ae5fd869 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:48.499563 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9d3c3292-2110-49ad-9896-9e91ae5fd869 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:48.500419 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9d3c3292-2110-49ad-9896-9e91ae5fd869 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:48.501396 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9d3c3292-2110-49ad-9896-9e91ae5fd869 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:48.563955 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Flavor limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:39:48.563955 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Image limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:39:48.563955 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Flavor pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:39:48.563955 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Image pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:39:48.563955 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:39:48.571304 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:48.576047 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:48.577280 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:48.579764 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:48.619205 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Getting quotas for project db9e9e54834e4fe682d4305010655be7. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:39:48.627775 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Getting quotas for user e2a2db05b54e45fba8475e7949a61d6a and project db9e9e54834e4fe682d4305010655be7. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:39:48.655474 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Going to run 1 instances... {{(pid=108439) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:39:48.660516 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:39:48.709133 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9d3c3292-2110-49ad-9896-9e91ae5fd869 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:48.718573 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-9d3c3292-2110-49ad-9896-9e91ae5fd869 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1315 microversion: 2.1 time: 0.245888 Aug 10 03:39:48.721351 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 37/67] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:48 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:48.796628 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-e6838224-24a7-4741-8da3-4a5d63648762 req-1da9dc52-6055-49f6-a808-5a58649befde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b15c91-649d-46ab-8a83-0af955b0034c", "name": "network-vif-plugged", "status": "completed", "tag": "de122834-5f01-4a99-9143-529a113b3416"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:48.798710 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:39:48.798710 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:39:48.805636 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-e6838224-24a7-4741-8da3-4a5d63648762 req-1da9dc52-6055-49f6-a808-5a58649befde service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:48.806068 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-e6838224-24a7-4741-8da3-4a5d63648762 req-1da9dc52-6055-49f6-a808-5a58649befde service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:48.818219 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-e6838224-24a7-4741-8da3-4a5d63648762 req-1da9dc52-6055-49f6-a808-5a58649befde service nova] Creating event network-vif-plugged:de122834-5f01-4a99-9143-529a113b3416 for instance 11b15c91-649d-46ab-8a83-0af955b0034c on hv-cinder-78239 Aug 10 03:39:48.823068 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-e6838224-24a7-4741-8da3-4a5d63648762 req-1da9dc52-6055-49f6-a808-5a58649befde service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100299 Aug 10 03:39:48.823776 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 38/68] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:39:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:39:48.836915 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a8608e63-c1f2-43b6-a0db-35dd8f29bb5d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:48.837605 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a8608e63-c1f2-43b6-a0db-35dd8f29bb5d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:48.843723 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a8608e63-c1f2-43b6-a0db-35dd8f29bb5d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:48.844429 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a8608e63-c1f2-43b6-a0db-35dd8f29bb5d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:48.845366 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a8608e63-c1f2-43b6-a0db-35dd8f29bb5d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:48.846048 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a8608e63-c1f2-43b6-a0db-35dd8f29bb5d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:48.886916 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-435300b6-4281-4bca-80b3-d4a2513d167e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.525938 Aug 10 03:39:48.888406 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 31/69] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:39:47 2021] POST /compute/v2.1/servers => generated 402 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 03:39:48.898919 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-db34adc1-42d1-49d3-9184-b03acc0b0287 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:48.899627 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-db34adc1-42d1-49d3-9184-b03acc0b0287 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:49.041194 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-db34adc1-42d1-49d3-9184-b03acc0b0287 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:49.049848 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-db34adc1-42d1-49d3-9184-b03acc0b0287 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1237 microversion: 2.1 time: 0.155150 Aug 10 03:39:49.052247 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 32/70] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:48 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1237 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:49.191206 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a8608e63-c1f2-43b6-a0db-35dd8f29bb5d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:49.199473 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a8608e63-c1f2-43b6-a0db-35dd8f29bb5d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1318 microversion: 2.1 time: 0.366065 Aug 10 03:39:49.213521 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 39/71] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:48 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:49.266711 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-acb55f16-9021-411f-bebe-a08da5a8b3a5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:49.267368 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-acb55f16-9021-411f-bebe-a08da5a8b3a5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:49.274486 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-acb55f16-9021-411f-bebe-a08da5a8b3a5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:49.275273 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-acb55f16-9021-411f-bebe-a08da5a8b3a5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:49.276385 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-acb55f16-9021-411f-bebe-a08da5a8b3a5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:49.277018 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-acb55f16-9021-411f-bebe-a08da5a8b3a5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:49.489365 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-549426d2-238a-443c-a978-b8be7b07c2ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:49.489980 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-549426d2-238a-443c-a978-b8be7b07c2ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:49.506082 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-549426d2-238a-443c-a978-b8be7b07c2ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:49.506535 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-549426d2-238a-443c-a978-b8be7b07c2ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:49.507325 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-549426d2-238a-443c-a978-b8be7b07c2ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:49.507754 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-549426d2-238a-443c-a978-b8be7b07c2ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:49.660316 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-acb55f16-9021-411f-bebe-a08da5a8b3a5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:49.667892 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-acb55f16-9021-411f-bebe-a08da5a8b3a5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1322 microversion: 2.1 time: 0.404804 Aug 10 03:39:49.668493 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 33/72] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:49 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:49.708808 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-549426d2-238a-443c-a978-b8be7b07c2ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:49.721742 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-549426d2-238a-443c-a978-b8be7b07c2ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:49.725919 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-549426d2-238a-443c-a978-b8be7b07c2ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:49.727038 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-549426d2-238a-443c-a978-b8be7b07c2ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1341 microversion: 2.20 time: 0.242140 Aug 10 03:39:49.727596 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 40/73] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:39:49 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1341 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:39:49.744189 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-4dc54402-b55f-4036-a3bb-4656d8aedd47 req-facfa911-3703-4cb8-9377-5624f998033f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c37d94-d078-4e35-819d-2ca11fc5cb5f", "tag": "88abaf7a-ebcd-437f-9081-731c60519ffb"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:49.744969 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e15b9e70-3a3a-4622-a9d5-0bc446435077 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:49.745746 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e15b9e70-3a3a-4622-a9d5-0bc446435077 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:49.749494 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:39:49.749494 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:39:49.753258 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e15b9e70-3a3a-4622-a9d5-0bc446435077 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:49.754077 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e15b9e70-3a3a-4622-a9d5-0bc446435077 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:49.755023 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e15b9e70-3a3a-4622-a9d5-0bc446435077 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:49.755650 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e15b9e70-3a3a-4622-a9d5-0bc446435077 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:49.767730 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-4dc54402-b55f-4036-a3bb-4656d8aedd47 req-facfa911-3703-4cb8-9377-5624f998033f service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:49.768555 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-4dc54402-b55f-4036-a3bb-4656d8aedd47 req-facfa911-3703-4cb8-9377-5624f998033f service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:49.814177 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-4dc54402-b55f-4036-a3bb-4656d8aedd47 req-facfa911-3703-4cb8-9377-5624f998033f service nova] Creating event network-changed:88abaf7a-ebcd-437f-9081-731c60519ffb for instance f2c37d94-d078-4e35-819d-2ca11fc5cb5f on hv-cinder-78239 Aug 10 03:39:49.815084 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-4dc54402-b55f-4036-a3bb-4656d8aedd47 req-facfa911-3703-4cb8-9377-5624f998033f service nova] Acquired lock "compute-rpcapi-router" {{(pid=108439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 10 03:39:49.816655 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a7c6b585-25f7-43fe-832b-1071603bd56b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:49.818696 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a7c6b585-25f7-43fe-832b-1071603bd56b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:49.819855 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a7c6b585-25f7-43fe-832b-1071603bd56b None None] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:49.820485 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a7c6b585-25f7-43fe-832b-1071603bd56b None None] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:49.830388 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.compute.rpcapi [None req-a7c6b585-25f7-43fe-832b-1071603bd56b None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Aug 10 03:39:49.831401 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a7c6b585-25f7-43fe-832b-1071603bd56b None None] Releasing lock "compute-rpcapi-router" {{(pid=108439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 10 03:39:49.858023 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a7c6b585-25f7-43fe-832b-1071603bd56b None None] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184722 Aug 10 03:39:49.859487 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 34/74] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:39:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:39:50.070745 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-4dae0389-6abf-4892-a014-2653eab573bf tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:50.071456 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-4dae0389-6abf-4892-a014-2653eab573bf tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:50.149509 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4dae0389-6abf-4892-a014-2653eab573bf tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:50.162289 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-4dae0389-6abf-4892-a014-2653eab573bf tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1237 microversion: 2.1 time: 0.096445 Aug 10 03:39:50.162289 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 35/75] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:50 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:50.176161 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e15b9e70-3a3a-4622-a9d5-0bc446435077 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:50.183559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e15b9e70-3a3a-4622-a9d5-0bc446435077 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1315 microversion: 2.1 time: 0.442813 Aug 10 03:39:50.192236 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 41/76] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:49 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:50.229146 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1657ce84-c2f4-4853-9025-8561c127ad55 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:50.229753 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1657ce84-c2f4-4853-9025-8561c127ad55 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:50.236000 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1657ce84-c2f4-4853-9025-8561c127ad55 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:50.236737 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1657ce84-c2f4-4853-9025-8561c127ad55 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:50.237681 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1657ce84-c2f4-4853-9025-8561c127ad55 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:50.238110 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1657ce84-c2f4-4853-9025-8561c127ad55 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:50.368188 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1657ce84-c2f4-4853-9025-8561c127ad55 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:50.375498 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1657ce84-c2f4-4853-9025-8561c127ad55 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1318 microversion: 2.1 time: 0.150112 Aug 10 03:39:50.385308 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 36/77] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:50 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:50.693374 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-37d27c19-ac7e-4f71-b2dc-8f4f2abb07d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:50.693374 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-37d27c19-ac7e-4f71-b2dc-8f4f2abb07d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:50.693374 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-37d27c19-ac7e-4f71-b2dc-8f4f2abb07d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:50.693374 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-37d27c19-ac7e-4f71-b2dc-8f4f2abb07d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:50.694041 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-37d27c19-ac7e-4f71-b2dc-8f4f2abb07d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:50.694041 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-37d27c19-ac7e-4f71-b2dc-8f4f2abb07d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:50.745541 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ac821edb-20c7-415d-be65-637252905ebb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:50.746322 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ac821edb-20c7-415d-be65-637252905ebb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:50.752555 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ac821edb-20c7-415d-be65-637252905ebb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:50.752995 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ac821edb-20c7-415d-be65-637252905ebb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:50.753775 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ac821edb-20c7-415d-be65-637252905ebb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:50.754201 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ac821edb-20c7-415d-be65-637252905ebb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:50.829763 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ac821edb-20c7-415d-be65-637252905ebb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:50.834287 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ac821edb-20c7-415d-be65-637252905ebb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:50.835939 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ac821edb-20c7-415d-be65-637252905ebb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:50.837060 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ac821edb-20c7-415d-be65-637252905ebb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1339 microversion: 2.20 time: 0.095281 Aug 10 03:39:50.839250 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 37/78] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:39:50 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1339 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:39:50.843705 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-eb5b8097-7284-41a4-b1a3-d091b284c5c8 req-5f2a6f26-3e16-4f15-843b-bd97ea7c1d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a912ff3-ac1a-4d82-971a-be7ebb16c176", "name": "network-vif-plugged", "status": "completed", "tag": "10d027a5-7309-4d2a-a189-a95629488e03"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:50.845999 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:39:50.845999 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:39:50.853268 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-eb5b8097-7284-41a4-b1a3-d091b284c5c8 req-5f2a6f26-3e16-4f15-843b-bd97ea7c1d22 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:50.853692 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-eb5b8097-7284-41a4-b1a3-d091b284c5c8 req-5f2a6f26-3e16-4f15-843b-bd97ea7c1d22 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:50.865359 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-eb5b8097-7284-41a4-b1a3-d091b284c5c8 req-5f2a6f26-3e16-4f15-843b-bd97ea7c1d22 service nova] Creating event network-vif-plugged:10d027a5-7309-4d2a-a189-a95629488e03 for instance 3a912ff3-ac1a-4d82-971a-be7ebb16c176 on hv-cinder-78239 Aug 10 03:39:50.870759 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-eb5b8097-7284-41a4-b1a3-d091b284c5c8 req-5f2a6f26-3e16-4f15-843b-bd97ea7c1d22 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031578 Aug 10 03:39:50.880923 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 38/79] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:39:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:39:50.994300 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-37d27c19-ac7e-4f71-b2dc-8f4f2abb07d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:51.001691 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-37d27c19-ac7e-4f71-b2dc-8f4f2abb07d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1322 microversion: 2.1 time: 0.320444 Aug 10 03:39:51.002238 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 42/80] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:50 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:51.179179 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b7b99b75-739b-44d0-b3ce-edb23dfd4256 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:51.180401 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b7b99b75-739b-44d0-b3ce-edb23dfd4256 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:51.187486 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b7b99b75-739b-44d0-b3ce-edb23dfd4256 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:51.188045 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b7b99b75-739b-44d0-b3ce-edb23dfd4256 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:51.188963 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b7b99b75-739b-44d0-b3ce-edb23dfd4256 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:51.189454 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b7b99b75-739b-44d0-b3ce-edb23dfd4256 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:51.200495 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a6793e59-af71-4e20-945c-b03a8958bce1 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:51.201108 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a6793e59-af71-4e20-945c-b03a8958bce1 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:51.219690 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a6793e59-af71-4e20-945c-b03a8958bce1 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:51.220161 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a6793e59-af71-4e20-945c-b03a8958bce1 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:51.221221 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a6793e59-af71-4e20-945c-b03a8958bce1 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:51.222326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a6793e59-af71-4e20-945c-b03a8958bce1 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:51.278091 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b7b99b75-739b-44d0-b3ce-edb23dfd4256 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:51.284933 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b7b99b75-739b-44d0-b3ce-edb23dfd4256 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1241 microversion: 2.1 time: 0.110704 Aug 10 03:39:51.286356 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 39/81] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:51 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:51.393536 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8ffe6558-19cb-4a0d-a1ce-641d5e574f4c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:51.394792 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8ffe6558-19cb-4a0d-a1ce-641d5e574f4c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:51.402835 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ffe6558-19cb-4a0d-a1ce-641d5e574f4c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:51.408225 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ffe6558-19cb-4a0d-a1ce-641d5e574f4c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:51.408225 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ffe6558-19cb-4a0d-a1ce-641d5e574f4c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:51.408225 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ffe6558-19cb-4a0d-a1ce-641d5e574f4c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:51.549325 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8ffe6558-19cb-4a0d-a1ce-641d5e574f4c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:51.561091 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8ffe6558-19cb-4a0d-a1ce-641d5e574f4c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1318 microversion: 2.1 time: 0.171196 Aug 10 03:39:51.572411 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 40/82] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:51 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:51.807250 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a6793e59-af71-4e20-945c-b03a8958bce1 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:51.814541 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a6793e59-af71-4e20-945c-b03a8958bce1 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1315 microversion: 2.1 time: 0.617831 Aug 10 03:39:51.820898 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 43/83] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:51 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:51.855712 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6a4bfd0c-bd4b-4b0e-bf72-2526e45b344c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:51.856355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6a4bfd0c-bd4b-4b0e-bf72-2526e45b344c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:51.862862 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6a4bfd0c-bd4b-4b0e-bf72-2526e45b344c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:51.863304 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6a4bfd0c-bd4b-4b0e-bf72-2526e45b344c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:51.864100 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6a4bfd0c-bd4b-4b0e-bf72-2526e45b344c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:51.864555 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6a4bfd0c-bd4b-4b0e-bf72-2526e45b344c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:51.927453 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6a4bfd0c-bd4b-4b0e-bf72-2526e45b344c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:51.949639 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6a4bfd0c-bd4b-4b0e-bf72-2526e45b344c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:51.951154 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6a4bfd0c-bd4b-4b0e-bf72-2526e45b344c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:51.952261 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6a4bfd0c-bd4b-4b0e-bf72-2526e45b344c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1339 microversion: 2.20 time: 0.100306 Aug 10 03:39:51.953069 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 41/84] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:39:51 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:39:52.022524 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d161696c-77b5-4d6a-a603-9d11eae8a040 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:52.022524 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d161696c-77b5-4d6a-a603-9d11eae8a040 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:52.023744 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d161696c-77b5-4d6a-a603-9d11eae8a040 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:52.024191 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d161696c-77b5-4d6a-a603-9d11eae8a040 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:52.024991 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d161696c-77b5-4d6a-a603-9d11eae8a040 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:52.025420 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d161696c-77b5-4d6a-a603-9d11eae8a040 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:52.264127 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d161696c-77b5-4d6a-a603-9d11eae8a040 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:52.271842 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d161696c-77b5-4d6a-a603-9d11eae8a040 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1322 microversion: 2.1 time: 0.258240 Aug 10 03:39:52.273087 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 44/85] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:52 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:52.304269 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e608c81e-d055-42d3-9e27-21160deeb640 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:52.304953 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e608c81e-d055-42d3-9e27-21160deeb640 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:52.314081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e608c81e-d055-42d3-9e27-21160deeb640 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:52.314722 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e608c81e-d055-42d3-9e27-21160deeb640 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:52.315712 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e608c81e-d055-42d3-9e27-21160deeb640 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:52.316307 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e608c81e-d055-42d3-9e27-21160deeb640 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:52.425618 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e608c81e-d055-42d3-9e27-21160deeb640 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:52.434730 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e608c81e-d055-42d3-9e27-21160deeb640 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1289 microversion: 2.1 time: 0.135503 Aug 10 03:39:52.437492 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 42/86] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:52 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1289 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:52.578054 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-65fb13da-426c-40b1-b76a-678304791d00 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:52.578832 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-65fb13da-426c-40b1-b76a-678304791d00 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:52.584577 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-65fb13da-426c-40b1-b76a-678304791d00 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:52.585017 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-65fb13da-426c-40b1-b76a-678304791d00 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:52.585837 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-65fb13da-426c-40b1-b76a-678304791d00 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:52.586234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-65fb13da-426c-40b1-b76a-678304791d00 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:52.832713 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-64d64e09-b934-4a1b-bb11-8ce5800e2a73 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:52.833290 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-64d64e09-b934-4a1b-bb11-8ce5800e2a73 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:52.841233 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-64d64e09-b934-4a1b-bb11-8ce5800e2a73 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:52.841717 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-64d64e09-b934-4a1b-bb11-8ce5800e2a73 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:52.842507 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-64d64e09-b934-4a1b-bb11-8ce5800e2a73 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:52.843117 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-64d64e09-b934-4a1b-bb11-8ce5800e2a73 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:52.867043 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-65fb13da-426c-40b1-b76a-678304791d00 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:52.875376 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-65fb13da-426c-40b1-b76a-678304791d00 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1318 microversion: 2.1 time: 0.300751 Aug 10 03:39:52.876439 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 45/87] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:52 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:52.970208 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-64d64e09-b934-4a1b-bb11-8ce5800e2a73 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:52.971123 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ab5fc9f6-f383-4601-a4bc-3edf672e4553 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:52.971763 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ab5fc9f6-f383-4601-a4bc-3edf672e4553 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:52.978625 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ab5fc9f6-f383-4601-a4bc-3edf672e4553 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:52.979206 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ab5fc9f6-f383-4601-a4bc-3edf672e4553 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:52.979784 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-64d64e09-b934-4a1b-bb11-8ce5800e2a73 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1501 microversion: 2.1 time: 0.151448 Aug 10 03:39:52.980218 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ab5fc9f6-f383-4601-a4bc-3edf672e4553 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:52.980453 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 43/88] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:52 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:52.980787 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ab5fc9f6-f383-4601-a4bc-3edf672e4553 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:53.292453 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ee13d672-2b0b-4425-a9c5-fd837e689e88 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:53.293576 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ee13d672-2b0b-4425-a9c5-fd837e689e88 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:53.305425 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ee13d672-2b0b-4425-a9c5-fd837e689e88 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:53.307825 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ee13d672-2b0b-4425-a9c5-fd837e689e88 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:53.309177 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ee13d672-2b0b-4425-a9c5-fd837e689e88 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:53.312085 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ee13d672-2b0b-4425-a9c5-fd837e689e88 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:53.455111 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ab5fc9f6-f383-4601-a4bc-3edf672e4553 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:53.469116 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ab5fc9f6-f383-4601-a4bc-3edf672e4553 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:53.471002 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ab5fc9f6-f383-4601-a4bc-3edf672e4553 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:53.472119 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ab5fc9f6-f383-4601-a4bc-3edf672e4553 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1407 microversion: 2.20 time: 0.505747 Aug 10 03:39:53.472710 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 46/89] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:39:52 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:39:53.484434 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-be2679c2-2ff8-4d1f-afa2-719c0cbfc27f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:53.491604 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-be2679c2-2ff8-4d1f-afa2-719c0cbfc27f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:53.512184 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-be2679c2-2ff8-4d1f-afa2-719c0cbfc27f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:53.513026 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-be2679c2-2ff8-4d1f-afa2-719c0cbfc27f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:53.514695 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-be2679c2-2ff8-4d1f-afa2-719c0cbfc27f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:53.515465 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-be2679c2-2ff8-4d1f-afa2-719c0cbfc27f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:53.567315 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ee13d672-2b0b-4425-a9c5-fd837e689e88 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:53.586562 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ee13d672-2b0b-4425-a9c5-fd837e689e88 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1322 microversion: 2.1 time: 0.294275 Aug 10 03:39:53.589040 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 44/90] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:53 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:53.663409 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-be2679c2-2ff8-4d1f-afa2-719c0cbfc27f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:53.684188 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-be2679c2-2ff8-4d1f-afa2-719c0cbfc27f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1295 microversion: 2.1 time: 0.205078 Aug 10 03:39:53.686471 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 47/91] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:53 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1295 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:53.900531 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-804b0f42-c804-4237-9e9c-832263aec6ea tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:53.901794 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-804b0f42-c804-4237-9e9c-832263aec6ea tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:53.919474 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-804b0f42-c804-4237-9e9c-832263aec6ea tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:53.919882 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-804b0f42-c804-4237-9e9c-832263aec6ea tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:53.920824 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-804b0f42-c804-4237-9e9c-832263aec6ea tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:53.921240 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-804b0f42-c804-4237-9e9c-832263aec6ea tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:53.962827 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-4829f263-91ca-4c68-b229-a481a5fbd134 req-134cd5d3-f0a7-44ff-8f39-96c2b628140f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c599984-f271-4886-be2f-73e7531f52e4", "tag": "54a387d8-dbe0-4a78-bbba-58f771dd4478"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:53.965836 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:39:53.965836 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:39:53.985790 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-4829f263-91ca-4c68-b229-a481a5fbd134 req-134cd5d3-f0a7-44ff-8f39-96c2b628140f service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:53.986793 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-4829f263-91ca-4c68-b229-a481a5fbd134 req-134cd5d3-f0a7-44ff-8f39-96c2b628140f service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:54.009480 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-4829f263-91ca-4c68-b229-a481a5fbd134 req-134cd5d3-f0a7-44ff-8f39-96c2b628140f service nova] Creating event network-changed:54a387d8-dbe0-4a78-bbba-58f771dd4478 for instance 0c599984-f271-4886-be2f-73e7531f52e4 on hv-cinder-78239 Aug 10 03:39:54.028486 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-4829f263-91ca-4c68-b229-a481a5fbd134 req-134cd5d3-f0a7-44ff-8f39-96c2b628140f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065772 Aug 10 03:39:54.033010 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 48/92] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:39:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:39:54.073300 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-17ac2b62-df1a-404c-8154-06c4b5939546 req-0b4e5e35-f0bc-4233-aa6b-fd0fb28e4d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280754b9-5f91-4b9c-a00e-59a052eaab43", "name": "network-vif-plugged", "status": "completed", "tag": "b8c15eaf-d642-44fa-8a94-a34fbb169d00"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:54.075256 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:39:54.075256 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:39:54.105768 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-17ac2b62-df1a-404c-8154-06c4b5939546 req-0b4e5e35-f0bc-4233-aa6b-fd0fb28e4d1e service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:54.106218 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-17ac2b62-df1a-404c-8154-06c4b5939546 req-0b4e5e35-f0bc-4233-aa6b-fd0fb28e4d1e service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:54.140462 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-17ac2b62-df1a-404c-8154-06c4b5939546 req-0b4e5e35-f0bc-4233-aa6b-fd0fb28e4d1e service nova] Creating event network-vif-plugged:b8c15eaf-d642-44fa-8a94-a34fbb169d00 for instance 280754b9-5f91-4b9c-a00e-59a052eaab43 on hv-cinder-78239 Aug 10 03:39:54.154721 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-17ac2b62-df1a-404c-8154-06c4b5939546 req-0b4e5e35-f0bc-4233-aa6b-fd0fb28e4d1e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089187 Aug 10 03:39:54.155322 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 49/93] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:39:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:39:54.287394 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-804b0f42-c804-4237-9e9c-832263aec6ea tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:54.298160 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-804b0f42-c804-4237-9e9c-832263aec6ea tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1507 microversion: 2.1 time: 0.405635 Aug 10 03:39:54.309247 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 45/94] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:53 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1507 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:54.491658 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0f29fae8-c04a-44d2-b46c-65707828497b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:54.492969 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0f29fae8-c04a-44d2-b46c-65707828497b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:54.504882 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f29fae8-c04a-44d2-b46c-65707828497b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:54.505654 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f29fae8-c04a-44d2-b46c-65707828497b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:54.507212 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f29fae8-c04a-44d2-b46c-65707828497b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:54.508164 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f29fae8-c04a-44d2-b46c-65707828497b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:54.604751 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-272cfb9c-a3af-44c7-a0f9-89cf1d4af0e0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:54.605288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-272cfb9c-a3af-44c7-a0f9-89cf1d4af0e0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:54.612168 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-272cfb9c-a3af-44c7-a0f9-89cf1d4af0e0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:54.613025 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-272cfb9c-a3af-44c7-a0f9-89cf1d4af0e0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:54.614031 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-272cfb9c-a3af-44c7-a0f9-89cf1d4af0e0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:54.614671 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-272cfb9c-a3af-44c7-a0f9-89cf1d4af0e0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:54.731685 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0f29fae8-c04a-44d2-b46c-65707828497b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:54.761443 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0f29fae8-c04a-44d2-b46c-65707828497b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:54.764956 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0f29fae8-c04a-44d2-b46c-65707828497b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:54.767517 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0f29fae8-c04a-44d2-b46c-65707828497b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1407 microversion: 2.20 time: 0.279940 Aug 10 03:39:54.781279 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-272cfb9c-a3af-44c7-a0f9-89cf1d4af0e0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:54.782348 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 50/95] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:39:54 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:39:54.794301 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-272cfb9c-a3af-44c7-a0f9-89cf1d4af0e0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1322 microversion: 2.1 time: 0.185518 Aug 10 03:39:54.794301 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 46/96] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:54 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:54.794593 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-9dc11cec-e16d-4b1e-a920-a83faed5d01f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:54.794593 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-9dc11cec-e16d-4b1e-a920-a83faed5d01f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:54.804911 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9dc11cec-e16d-4b1e-a920-a83faed5d01f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:54.805533 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9dc11cec-e16d-4b1e-a920-a83faed5d01f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:54.806690 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9dc11cec-e16d-4b1e-a920-a83faed5d01f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:54.807309 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9dc11cec-e16d-4b1e-a920-a83faed5d01f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:54.917019 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9dc11cec-e16d-4b1e-a920-a83faed5d01f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:54.925411 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-9dc11cec-e16d-4b1e-a920-a83faed5d01f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1295 microversion: 2.1 time: 0.141594 Aug 10 03:39:54.926255 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 51/97] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:54 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1295 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:55.368690 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9d58fc2c-2483-4abd-ad58-bdbcc3e8627c tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdacd67f-ee57-494c-b960-ef15e49158ab"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:55.369827 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9d58fc2c-2483-4abd-ad58-bdbcc3e8627c tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:55.376644 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9d58fc2c-2483-4abd-ad58-bdbcc3e8627c tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:55.377432 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9d58fc2c-2483-4abd-ad58-bdbcc3e8627c tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:55.378276 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9d58fc2c-2483-4abd-ad58-bdbcc3e8627c tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:55.378863 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9d58fc2c-2483-4abd-ad58-bdbcc3e8627c tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:55.794164 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-cca414ff-99cf-49b3-b0c5-5d6afb6de549 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:55.794877 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-cca414ff-99cf-49b3-b0c5-5d6afb6de549 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:55.810055 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cca414ff-99cf-49b3-b0c5-5d6afb6de549 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:55.812588 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cca414ff-99cf-49b3-b0c5-5d6afb6de549 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:55.829600 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cca414ff-99cf-49b3-b0c5-5d6afb6de549 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:55.837095 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cca414ff-99cf-49b3-b0c5-5d6afb6de549 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:56.123505 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-cca414ff-99cf-49b3-b0c5-5d6afb6de549 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:56.133408 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-cca414ff-99cf-49b3-b0c5-5d6afb6de549 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:56.135305 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-cca414ff-99cf-49b3-b0c5-5d6afb6de549 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:56.136508 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-cca414ff-99cf-49b3-b0c5-5d6afb6de549 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1407 microversion: 2.20 time: 0.346032 Aug 10 03:39:56.137086 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 52/98] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:39:55 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1407 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:39:56.193065 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-521ab7ff-f0d8-48b2-bd86-da28e255e09d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:56.193805 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-521ab7ff-f0d8-48b2-bd86-da28e255e09d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:56.204995 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-521ab7ff-f0d8-48b2-bd86-da28e255e09d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:56.206917 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-521ab7ff-f0d8-48b2-bd86-da28e255e09d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:56.209727 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-521ab7ff-f0d8-48b2-bd86-da28e255e09d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:56.210430 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-521ab7ff-f0d8-48b2-bd86-da28e255e09d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:56.577558 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-521ab7ff-f0d8-48b2-bd86-da28e255e09d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:56.586419 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-521ab7ff-f0d8-48b2-bd86-da28e255e09d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1322 microversion: 2.1 time: 0.447807 Aug 10 03:39:56.597048 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 53/99] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:56 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1322 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:56.602234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7c2a744d-fde7-40b9-8951-4c10a1289b69 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:56.603124 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7c2a744d-fde7-40b9-8951-4c10a1289b69 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:56.610948 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c2a744d-fde7-40b9-8951-4c10a1289b69 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:56.611643 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c2a744d-fde7-40b9-8951-4c10a1289b69 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:56.616789 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c2a744d-fde7-40b9-8951-4c10a1289b69 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:56.616789 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c2a744d-fde7-40b9-8951-4c10a1289b69 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:56.767397 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7c2a744d-fde7-40b9-8951-4c10a1289b69 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:56.774595 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7c2a744d-fde7-40b9-8951-4c10a1289b69 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1363 microversion: 2.1 time: 0.176454 Aug 10 03:39:56.775154 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 54/100] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:56 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:56.779364 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-241eb706-b2a0-4f47-a865-094ae0e84a69 req-52d54469-946c-456f-b084-f33a4b77d80e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c37d94-d078-4e35-819d-2ca11fc5cb5f", "name": "network-vif-plugged", "status": "completed", "tag": "88abaf7a-ebcd-437f-9081-731c60519ffb"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:56.781015 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:39:56.781015 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:39:56.788124 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-241eb706-b2a0-4f47-a865-094ae0e84a69 req-52d54469-946c-456f-b084-f33a4b77d80e service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:56.788684 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-241eb706-b2a0-4f47-a865-094ae0e84a69 req-52d54469-946c-456f-b084-f33a4b77d80e service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:56.807208 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-241eb706-b2a0-4f47-a865-094ae0e84a69 req-52d54469-946c-456f-b084-f33a4b77d80e service nova] Creating event network-vif-plugged:88abaf7a-ebcd-437f-9081-731c60519ffb for instance f2c37d94-d078-4e35-819d-2ca11fc5cb5f on hv-cinder-78239 Aug 10 03:39:56.808683 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-241eb706-b2a0-4f47-a865-094ae0e84a69 req-52d54469-946c-456f-b084-f33a4b77d80e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032068 Aug 10 03:39:56.809821 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 55/101] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:39:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:39:56.816472 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-be16426f-0b84-438b-aa51-f25a443016bc tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1374aed3-40a8-44e1-a84e-89ca17489689"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:56.818416 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-be16426f-0b84-438b-aa51-f25a443016bc tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:56.826649 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-be16426f-0b84-438b-aa51-f25a443016bc tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:56.827086 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-be16426f-0b84-438b-aa51-f25a443016bc tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:56.827890 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-be16426f-0b84-438b-aa51-f25a443016bc tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:56.828344 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-be16426f-0b84-438b-aa51-f25a443016bc tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:56.915308 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9d58fc2c-2483-4abd-ad58-bdbcc3e8627c tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "POST /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.549330 Aug 10 03:39:56.915308 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 47/102] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 10 03:39:55 2021] POST /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c/os-volume_attachments => generated 194 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:39:57.035273 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-47887721-ebdc-4b88-8195-3a286a10620c req-c0cd6ce0-c3c5-4032-a106-54ffc6fed825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b3a59e0-96ca-48a8-a62f-c6fef743ce89", "tag": "12cb09a3-9484-46a1-8f5c-54e53b12470c"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:57.036861 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:39:57.036861 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:39:57.046132 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-47887721-ebdc-4b88-8195-3a286a10620c req-c0cd6ce0-c3c5-4032-a106-54ffc6fed825 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:57.046567 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-47887721-ebdc-4b88-8195-3a286a10620c req-c0cd6ce0-c3c5-4032-a106-54ffc6fed825 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:57.057688 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-47887721-ebdc-4b88-8195-3a286a10620c req-c0cd6ce0-c3c5-4032-a106-54ffc6fed825 service nova] Creating event network-changed:12cb09a3-9484-46a1-8f5c-54e53b12470c for instance 8b3a59e0-96ca-48a8-a62f-c6fef743ce89 on hv-cinder-78239 Aug 10 03:39:57.068604 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-47887721-ebdc-4b88-8195-3a286a10620c req-c0cd6ce0-c3c5-4032-a106-54ffc6fed825 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036092 Aug 10 03:39:57.068604 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 48/103] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:39:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:39:57.160414 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-7d8caf8a-d1fb-45d2-a98e-a9eff4d2b004 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:57.160414 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-7d8caf8a-d1fb-45d2-a98e-a9eff4d2b004 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:57.161891 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7d8caf8a-d1fb-45d2-a98e-a9eff4d2b004 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:57.162339 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7d8caf8a-d1fb-45d2-a98e-a9eff4d2b004 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:57.163119 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7d8caf8a-d1fb-45d2-a98e-a9eff4d2b004 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:57.163551 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7d8caf8a-d1fb-45d2-a98e-a9eff4d2b004 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:57.340647 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-7d8caf8a-d1fb-45d2-a98e-a9eff4d2b004 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:57.349947 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-7d8caf8a-d1fb-45d2-a98e-a9eff4d2b004 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:57.351487 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-7d8caf8a-d1fb-45d2-a98e-a9eff4d2b004 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:57.352533 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-7d8caf8a-d1fb-45d2-a98e-a9eff4d2b004 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1407 microversion: 2.20 time: 0.201859 Aug 10 03:39:57.353801 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 49/104] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:39:57 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:39:57.603590 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-80f80963-c310-4e05-8cc4-be1b949257cc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:57.604356 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-80f80963-c310-4e05-8cc4-be1b949257cc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:57.612014 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-80f80963-c310-4e05-8cc4-be1b949257cc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:57.615075 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-80f80963-c310-4e05-8cc4-be1b949257cc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:57.615075 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-80f80963-c310-4e05-8cc4-be1b949257cc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:57.615075 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-80f80963-c310-4e05-8cc4-be1b949257cc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:57.736601 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-80f80963-c310-4e05-8cc4-be1b949257cc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:57.747100 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-80f80963-c310-4e05-8cc4-be1b949257cc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1517 microversion: 2.1 time: 0.144232 Aug 10 03:39:57.747100 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 50/105] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:57 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1517 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:39:57.761136 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-45f3e91f-dbcf-4bd5-9c97-147b4f8ff647 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:39:57.762124 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-45f3e91f-dbcf-4bd5-9c97-147b4f8ff647 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:57.768485 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-45f3e91f-dbcf-4bd5-9c97-147b4f8ff647 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:57.768936 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-45f3e91f-dbcf-4bd5-9c97-147b4f8ff647 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:57.769703 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-45f3e91f-dbcf-4bd5-9c97-147b4f8ff647 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:57.770138 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-45f3e91f-dbcf-4bd5-9c97-147b4f8ff647 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:57.794072 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-45f3e91f-dbcf-4bd5-9c97-147b4f8ff647 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lazy-loading 'flavor' on Instance uuid 280754b9-5f91-4b9c-a00e-59a052eaab43 {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:39:58.357479 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-45f3e91f-dbcf-4bd5-9c97-147b4f8ff647 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "POST /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43/action" status: 200 len: 32 microversion: 2.1 time: 0.600401 Aug 10 03:39:58.364290 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 51/106] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:39:57 2021] POST /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43/action => generated 32 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 03:39:58.376973 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0cb6ec1d-a461-47d7-81e7-ee19029bfecd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:58.378282 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0cb6ec1d-a461-47d7-81e7-ee19029bfecd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:58.386375 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0cb6ec1d-a461-47d7-81e7-ee19029bfecd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:58.387110 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0cb6ec1d-a461-47d7-81e7-ee19029bfecd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:58.388845 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0cb6ec1d-a461-47d7-81e7-ee19029bfecd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:58.389468 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0cb6ec1d-a461-47d7-81e7-ee19029bfecd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:58.509623 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-be16426f-0b84-438b-aa51-f25a443016bc tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "POST /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.698523 Aug 10 03:39:58.510210 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 56/107] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 10 03:39:56 2021] POST /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176/os-volume_attachments => generated 194 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:39:58.517808 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7fa8dbd9-41c4-4c27-836c-fcc4124e7378 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:58.518590 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7fa8dbd9-41c4-4c27-836c-fcc4124e7378 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:58.527363 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7fa8dbd9-41c4-4c27-836c-fcc4124e7378 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:58.527901 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7fa8dbd9-41c4-4c27-836c-fcc4124e7378 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:58.528793 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7fa8dbd9-41c4-4c27-836c-fcc4124e7378 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:58.529293 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7fa8dbd9-41c4-4c27-836c-fcc4124e7378 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:58.590394 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0cb6ec1d-a461-47d7-81e7-ee19029bfecd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:58.600084 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0cb6ec1d-a461-47d7-81e7-ee19029bfecd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1363 microversion: 2.1 time: 0.237066 Aug 10 03:39:58.600346 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 52/108] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:58 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:58.604948 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-69056332-f079-40f1-a2ac-1faa39d10499 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:58.605763 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-69056332-f079-40f1-a2ac-1faa39d10499 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:58.612896 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-69056332-f079-40f1-a2ac-1faa39d10499 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:58.613388 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-69056332-f079-40f1-a2ac-1faa39d10499 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:58.614170 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-69056332-f079-40f1-a2ac-1faa39d10499 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:58.614606 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-69056332-f079-40f1-a2ac-1faa39d10499 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:58.757721 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-69056332-f079-40f1-a2ac-1faa39d10499 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:58.765594 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-69056332-f079-40f1-a2ac-1faa39d10499 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.163980 Aug 10 03:39:58.766595 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 53/109] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:58 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:58.842879 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7fa8dbd9-41c4-4c27-836c-fcc4124e7378 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:58.854831 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7fa8dbd9-41c4-4c27-836c-fcc4124e7378 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:58.858158 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7fa8dbd9-41c4-4c27-836c-fcc4124e7378 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:58.864493 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7fa8dbd9-41c4-4c27-836c-fcc4124e7378 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1407 microversion: 2.20 time: 0.348625 Aug 10 03:39:58.864493 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 57/110] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:39:58 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1407 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:39:59.618950 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-98ec27b8-bc56-4509-9406-9d981ce4327b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:59.619657 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-98ec27b8-bc56-4509-9406-9d981ce4327b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:59.626999 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-98ec27b8-bc56-4509-9406-9d981ce4327b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:59.627503 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-98ec27b8-bc56-4509-9406-9d981ce4327b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:59.628603 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-98ec27b8-bc56-4509-9406-9d981ce4327b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:59.629034 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-98ec27b8-bc56-4509-9406-9d981ce4327b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:59.759510 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-98ec27b8-bc56-4509-9406-9d981ce4327b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:59.767252 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-98ec27b8-bc56-4509-9406-9d981ce4327b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1363 microversion: 2.1 time: 0.152133 Aug 10 03:39:59.775763 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 54/111] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:59 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:39:59.782600 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f6e8e239-8e70-49d8-b08d-5f58bd286995 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:59.783212 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f6e8e239-8e70-49d8-b08d-5f58bd286995 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:59.789154 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6e8e239-8e70-49d8-b08d-5f58bd286995 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:59.789595 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6e8e239-8e70-49d8-b08d-5f58bd286995 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:59.790354 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6e8e239-8e70-49d8-b08d-5f58bd286995 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:59.790784 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6e8e239-8e70-49d8-b08d-5f58bd286995 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:59.879334 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-237076f8-6063-4b95-8549-2d93197c1d68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:39:59.879934 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-237076f8-6063-4b95-8549-2d93197c1d68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:39:59.888747 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-237076f8-6063-4b95-8549-2d93197c1d68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:59.889194 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-237076f8-6063-4b95-8549-2d93197c1d68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:59.890126 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-237076f8-6063-4b95-8549-2d93197c1d68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:39:59.890555 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-237076f8-6063-4b95-8549-2d93197c1d68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:39:59.935691 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f6e8e239-8e70-49d8-b08d-5f58bd286995 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:39:59.962179 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f6e8e239-8e70-49d8-b08d-5f58bd286995 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.165162 Aug 10 03:39:59.962179 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 58/112] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:39:59 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:00.026691 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-237076f8-6063-4b95-8549-2d93197c1d68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:00.034436 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-237076f8-6063-4b95-8549-2d93197c1d68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:00.035931 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-237076f8-6063-4b95-8549-2d93197c1d68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:00.037039 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-237076f8-6063-4b95-8549-2d93197c1d68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1407 microversion: 2.20 time: 0.161981 Aug 10 03:40:00.037597 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 55/113] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:39:59 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:40:00.784667 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-66bb1301-49a0-4eaf-a3c7-3bb19e0f2ba9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:00.785364 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-66bb1301-49a0-4eaf-a3c7-3bb19e0f2ba9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:00.801930 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-66bb1301-49a0-4eaf-a3c7-3bb19e0f2ba9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:00.801930 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-66bb1301-49a0-4eaf-a3c7-3bb19e0f2ba9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:00.801930 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-66bb1301-49a0-4eaf-a3c7-3bb19e0f2ba9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:00.801930 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-66bb1301-49a0-4eaf-a3c7-3bb19e0f2ba9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:00.947826 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-66bb1301-49a0-4eaf-a3c7-3bb19e0f2ba9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:00.956147 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-66bb1301-49a0-4eaf-a3c7-3bb19e0f2ba9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1363 microversion: 2.1 time: 0.176091 Aug 10 03:40:01.007603 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 59/114] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:00 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:01.008757 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-77686c5c-6c31-4d14-8a7a-727eb883b979 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:01.008757 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-77686c5c-6c31-4d14-8a7a-727eb883b979 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:01.008757 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-77686c5c-6c31-4d14-8a7a-727eb883b979 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:01.008757 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-77686c5c-6c31-4d14-8a7a-727eb883b979 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:01.009731 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-77686c5c-6c31-4d14-8a7a-727eb883b979 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:01.009731 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-77686c5c-6c31-4d14-8a7a-727eb883b979 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:01.054701 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0d7b0ebf-8a68-47b5-9179-b7297bdbf222 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:01.055497 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0d7b0ebf-8a68-47b5-9179-b7297bdbf222 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:01.065486 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0d7b0ebf-8a68-47b5-9179-b7297bdbf222 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:01.076661 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0d7b0ebf-8a68-47b5-9179-b7297bdbf222 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:01.076661 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0d7b0ebf-8a68-47b5-9179-b7297bdbf222 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:01.076661 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0d7b0ebf-8a68-47b5-9179-b7297bdbf222 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:01.097893 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-77686c5c-6c31-4d14-8a7a-727eb883b979 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:01.106492 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-77686c5c-6c31-4d14-8a7a-727eb883b979 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.148129 Aug 10 03:40:01.107091 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 56/115] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:00 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:01.204894 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0d7b0ebf-8a68-47b5-9179-b7297bdbf222 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:01.213449 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0d7b0ebf-8a68-47b5-9179-b7297bdbf222 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:01.215039 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0d7b0ebf-8a68-47b5-9179-b7297bdbf222 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:01.216112 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0d7b0ebf-8a68-47b5-9179-b7297bdbf222 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1407 microversion: 2.20 time: 0.165179 Aug 10 03:40:01.216712 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 60/116] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:40:01 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:40:01.986786 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-83027296-d5ce-4a39-8714-4815360803a5 req-4160b542-87ca-4b89-9516-22d8ab6dbd0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c599984-f271-4886-be2f-73e7531f52e4", "name": "network-vif-plugged", "status": "completed", "tag": "54a387d8-dbe0-4a78-bbba-58f771dd4478"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:01.988453 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:40:01.988453 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:40:01.995937 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-83027296-d5ce-4a39-8714-4815360803a5 req-4160b542-87ca-4b89-9516-22d8ab6dbd0d service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:01.996422 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-83027296-d5ce-4a39-8714-4815360803a5 req-4160b542-87ca-4b89-9516-22d8ab6dbd0d service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:02.006039 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-14780c2e-048f-4f9f-9332-6db41826a352 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:02.008950 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-14780c2e-048f-4f9f-9332-6db41826a352 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:02.009222 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-83027296-d5ce-4a39-8714-4815360803a5 req-4160b542-87ca-4b89-9516-22d8ab6dbd0d service nova] Creating event network-vif-plugged:54a387d8-dbe0-4a78-bbba-58f771dd4478 for instance 0c599984-f271-4886-be2f-73e7531f52e4 on hv-cinder-78239 Aug 10 03:40:02.013756 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-83027296-d5ce-4a39-8714-4815360803a5 req-4160b542-87ca-4b89-9516-22d8ab6dbd0d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031436 Aug 10 03:40:02.014777 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 57/117] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:40:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:40:02.015369 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-14780c2e-048f-4f9f-9332-6db41826a352 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:02.015823 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-14780c2e-048f-4f9f-9332-6db41826a352 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:02.016891 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-14780c2e-048f-4f9f-9332-6db41826a352 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:02.017384 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-14780c2e-048f-4f9f-9332-6db41826a352 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:02.123114 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b776a608-148d-4b5c-885d-e7c5d13be653 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:02.126407 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b776a608-148d-4b5c-885d-e7c5d13be653 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:02.133288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b776a608-148d-4b5c-885d-e7c5d13be653 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:02.133965 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b776a608-148d-4b5c-885d-e7c5d13be653 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:02.134906 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b776a608-148d-4b5c-885d-e7c5d13be653 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:02.135487 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b776a608-148d-4b5c-885d-e7c5d13be653 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:02.184737 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-14780c2e-048f-4f9f-9332-6db41826a352 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:02.196147 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-14780c2e-048f-4f9f-9332-6db41826a352 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1363 microversion: 2.1 time: 0.193799 Aug 10 03:40:02.197498 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 61/118] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:02 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:02.238336 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-bb1b4ebb-7082-4fe5-a745-fd8d9cb50c60 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:02.239118 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-bb1b4ebb-7082-4fe5-a745-fd8d9cb50c60 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:02.247571 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ebb-7082-4fe5-a745-fd8d9cb50c60 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:02.248143 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ebb-7082-4fe5-a745-fd8d9cb50c60 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:02.249045 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ebb-7082-4fe5-a745-fd8d9cb50c60 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:02.249574 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ebb-7082-4fe5-a745-fd8d9cb50c60 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:02.301888 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b776a608-148d-4b5c-885d-e7c5d13be653 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:02.310738 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b776a608-148d-4b5c-885d-e7c5d13be653 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.191519 Aug 10 03:40:02.311505 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 58/119] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:02 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:02.411275 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-bb1b4ebb-7082-4fe5-a745-fd8d9cb50c60 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:02.419614 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-bb1b4ebb-7082-4fe5-a745-fd8d9cb50c60 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:02.421414 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-bb1b4ebb-7082-4fe5-a745-fd8d9cb50c60 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:02.423239 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-bb1b4ebb-7082-4fe5-a745-fd8d9cb50c60 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1407 microversion: 2.20 time: 0.188775 Aug 10 03:40:02.423797 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 62/120] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:40:02 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:40:03.213343 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d7859102-70f1-445e-a867-db2eaf59649e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:03.213956 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d7859102-70f1-445e-a867-db2eaf59649e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:03.220753 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d7859102-70f1-445e-a867-db2eaf59649e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:03.221403 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d7859102-70f1-445e-a867-db2eaf59649e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:03.222264 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d7859102-70f1-445e-a867-db2eaf59649e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:03.222683 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d7859102-70f1-445e-a867-db2eaf59649e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:03.327373 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-9fb88762-50c1-4c14-88f0-fef6f257bd00 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:03.328163 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-9fb88762-50c1-4c14-88f0-fef6f257bd00 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:03.336828 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9fb88762-50c1-4c14-88f0-fef6f257bd00 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:03.337267 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9fb88762-50c1-4c14-88f0-fef6f257bd00 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:03.338045 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9fb88762-50c1-4c14-88f0-fef6f257bd00 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:03.338471 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9fb88762-50c1-4c14-88f0-fef6f257bd00 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:03.358001 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d7859102-70f1-445e-a867-db2eaf59649e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:03.371507 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d7859102-70f1-445e-a867-db2eaf59649e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1363 microversion: 2.1 time: 0.161695 Aug 10 03:40:03.373245 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 59/121] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:03 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:03.441227 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0467829b-ba30-4b0a-9e8c-5496cfe9ef78 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:03.441970 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0467829b-ba30-4b0a-9e8c-5496cfe9ef78 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:03.447825 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0467829b-ba30-4b0a-9e8c-5496cfe9ef78 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:03.448511 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0467829b-ba30-4b0a-9e8c-5496cfe9ef78 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:03.449321 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0467829b-ba30-4b0a-9e8c-5496cfe9ef78 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:03.449748 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0467829b-ba30-4b0a-9e8c-5496cfe9ef78 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:03.467621 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9fb88762-50c1-4c14-88f0-fef6f257bd00 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:03.475138 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-9fb88762-50c1-4c14-88f0-fef6f257bd00 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.151513 Aug 10 03:40:03.478576 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 63/122] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:03 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:03.572860 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0467829b-ba30-4b0a-9e8c-5496cfe9ef78 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:03.580884 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0467829b-ba30-4b0a-9e8c-5496cfe9ef78 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:03.582378 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0467829b-ba30-4b0a-9e8c-5496cfe9ef78 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:03.583515 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0467829b-ba30-4b0a-9e8c-5496cfe9ef78 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1407 microversion: 2.20 time: 0.146752 Aug 10 03:40:03.584067 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 60/123] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:40:03 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:40:04.390309 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-fbdbffe2-3dc8-4f16-8d24-15a489e0d6aa tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:04.390309 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-fbdbffe2-3dc8-4f16-8d24-15a489e0d6aa tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:04.397178 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fbdbffe2-3dc8-4f16-8d24-15a489e0d6aa tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:04.397731 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fbdbffe2-3dc8-4f16-8d24-15a489e0d6aa tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:04.398526 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fbdbffe2-3dc8-4f16-8d24-15a489e0d6aa tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:04.398954 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fbdbffe2-3dc8-4f16-8d24-15a489e0d6aa tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:04.492244 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-fbd0b62a-4f31-4357-8265-08c1315b79a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:04.492861 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-fbd0b62a-4f31-4357-8265-08c1315b79a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:04.499604 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbd0b62a-4f31-4357-8265-08c1315b79a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:04.500348 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbd0b62a-4f31-4357-8265-08c1315b79a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:04.501147 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbd0b62a-4f31-4357-8265-08c1315b79a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:04.501832 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbd0b62a-4f31-4357-8265-08c1315b79a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:04.545195 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-fbdbffe2-3dc8-4f16-8d24-15a489e0d6aa tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:04.553297 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-fbdbffe2-3dc8-4f16-8d24-15a489e0d6aa tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1363 microversion: 2.1 time: 0.167458 Aug 10 03:40:04.553876 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 64/124] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:04 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:04.603190 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-285e8c69-b734-4fcd-838c-9415f00359f7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:04.603839 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-285e8c69-b734-4fcd-838c-9415f00359f7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:04.612129 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-285e8c69-b734-4fcd-838c-9415f00359f7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:04.617744 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-285e8c69-b734-4fcd-838c-9415f00359f7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:04.617744 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-285e8c69-b734-4fcd-838c-9415f00359f7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:04.617744 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-285e8c69-b734-4fcd-838c-9415f00359f7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:04.635966 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-fbd0b62a-4f31-4357-8265-08c1315b79a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:04.643120 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-fbd0b62a-4f31-4357-8265-08c1315b79a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.154814 Aug 10 03:40:04.643678 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 61/125] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:04 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:04.752003 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-285e8c69-b734-4fcd-838c-9415f00359f7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:04.759704 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-285e8c69-b734-4fcd-838c-9415f00359f7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:04.761278 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-285e8c69-b734-4fcd-838c-9415f00359f7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:04.762347 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-285e8c69-b734-4fcd-838c-9415f00359f7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1407 microversion: 2.20 time: 0.163517 Aug 10 03:40:04.762884 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 65/126] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:40:04 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:40:05.575701 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ecd6356c-445d-4c57-84b8-87bc0ef0c176 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:05.575701 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ecd6356c-445d-4c57-84b8-87bc0ef0c176 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:05.581139 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ecd6356c-445d-4c57-84b8-87bc0ef0c176 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:05.581306 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ecd6356c-445d-4c57-84b8-87bc0ef0c176 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:05.581976 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ecd6356c-445d-4c57-84b8-87bc0ef0c176 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:05.582398 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ecd6356c-445d-4c57-84b8-87bc0ef0c176 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:05.663803 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1ca58144-a6b0-4226-8e33-f91ae8e160ce tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:05.669766 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1ca58144-a6b0-4226-8e33-f91ae8e160ce tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:05.677670 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1ca58144-a6b0-4226-8e33-f91ae8e160ce tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:05.678241 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1ca58144-a6b0-4226-8e33-f91ae8e160ce tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:05.679117 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1ca58144-a6b0-4226-8e33-f91ae8e160ce tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:05.679672 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1ca58144-a6b0-4226-8e33-f91ae8e160ce tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:05.734953 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ecd6356c-445d-4c57-84b8-87bc0ef0c176 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:05.744249 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ecd6356c-445d-4c57-84b8-87bc0ef0c176 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1363 microversion: 2.1 time: 0.177841 Aug 10 03:40:05.745007 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 62/127] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:05 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:05.785789 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3676bdf7-12c1-4528-9f80-c8069292ebbd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:05.786549 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3676bdf7-12c1-4528-9f80-c8069292ebbd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:05.811684 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3676bdf7-12c1-4528-9f80-c8069292ebbd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:05.811888 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1ca58144-a6b0-4226-8e33-f91ae8e160ce tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:05.812125 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3676bdf7-12c1-4528-9f80-c8069292ebbd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:05.812922 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3676bdf7-12c1-4528-9f80-c8069292ebbd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:05.813445 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3676bdf7-12c1-4528-9f80-c8069292ebbd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:05.819904 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1ca58144-a6b0-4226-8e33-f91ae8e160ce tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.159678 Aug 10 03:40:05.821059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 66/128] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:05 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:05.939452 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-7b5df041-2991-4575-989e-b88d8b17e262 req-d6701af1-119b-4921-a850-752bdb639280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b3a59e0-96ca-48a8-a62f-c6fef743ce89", "name": "network-vif-plugged", "status": "completed", "tag": "12cb09a3-9484-46a1-8f5c-54e53b12470c"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:05.944637 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:40:05.944637 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:40:05.949220 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-7b5df041-2991-4575-989e-b88d8b17e262 req-d6701af1-119b-4921-a850-752bdb639280 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:05.949653 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-7b5df041-2991-4575-989e-b88d8b17e262 req-d6701af1-119b-4921-a850-752bdb639280 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:05.961710 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-7b5df041-2991-4575-989e-b88d8b17e262 req-d6701af1-119b-4921-a850-752bdb639280 service nova] Creating event network-vif-plugged:12cb09a3-9484-46a1-8f5c-54e53b12470c for instance 8b3a59e0-96ca-48a8-a62f-c6fef743ce89 on hv-cinder-78239 Aug 10 03:40:05.963888 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3676bdf7-12c1-4528-9f80-c8069292ebbd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:05.966778 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-7b5df041-2991-4575-989e-b88d8b17e262 req-d6701af1-119b-4921-a850-752bdb639280 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031479 Aug 10 03:40:05.967806 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 67/129] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:40:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:40:05.973889 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3676bdf7-12c1-4528-9f80-c8069292ebbd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:05.975411 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3676bdf7-12c1-4528-9f80-c8069292ebbd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:05.976604 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3676bdf7-12c1-4528-9f80-c8069292ebbd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1599 microversion: 2.20 time: 0.199679 Aug 10 03:40:05.977143 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 63/130] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:40:05 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1599 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:40:05.995340 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1e7562df-7f3b-4ddb-99e4-ed9ba377d74a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:05.995914 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1e7562df-7f3b-4ddb-99e4-ed9ba377d74a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:06.002543 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1e7562df-7f3b-4ddb-99e4-ed9ba377d74a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:06.003852 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1e7562df-7f3b-4ddb-99e4-ed9ba377d74a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:06.003852 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1e7562df-7f3b-4ddb-99e4-ed9ba377d74a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:06.004150 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1e7562df-7f3b-4ddb-99e4-ed9ba377d74a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:06.131873 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1e7562df-7f3b-4ddb-99e4-ed9ba377d74a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.140429 Aug 10 03:40:06.132833 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 68/131] 10.222.0.21 () {60 vars in 1316 bytes} [Tue Aug 10 03:40:05 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:40:06.761389 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-168e9fe0-159b-4599-9cf8-78670050af3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:06.762705 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-168e9fe0-159b-4599-9cf8-78670050af3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:06.769075 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-168e9fe0-159b-4599-9cf8-78670050af3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:06.769593 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-168e9fe0-159b-4599-9cf8-78670050af3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:06.770434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-168e9fe0-159b-4599-9cf8-78670050af3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:06.770919 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-168e9fe0-159b-4599-9cf8-78670050af3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:06.837404 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-5d493e94-7c11-4e23-b664-de9c7a4f5eb6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:06.838321 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-5d493e94-7c11-4e23-b664-de9c7a4f5eb6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:06.847276 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5d493e94-7c11-4e23-b664-de9c7a4f5eb6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:06.847886 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5d493e94-7c11-4e23-b664-de9c7a4f5eb6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:06.848873 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5d493e94-7c11-4e23-b664-de9c7a4f5eb6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:06.849404 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5d493e94-7c11-4e23-b664-de9c7a4f5eb6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:06.994825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-5d493e94-7c11-4e23-b664-de9c7a4f5eb6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:07.004426 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-5d493e94-7c11-4e23-b664-de9c7a4f5eb6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.170755 Aug 10 03:40:07.009847 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 69/132] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:06 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:07.143766 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-168e9fe0-159b-4599-9cf8-78670050af3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:07.151023 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-168e9fe0-159b-4599-9cf8-78670050af3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1363 microversion: 2.1 time: 0.393564 Aug 10 03:40:07.151580 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 64/133] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:06 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1363 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:07.676942 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-5ad01b08-3a8b-49fd-9b0a-ba56fe8f875d req-723c0073-25bd-4b26-b421-725ff85ecd1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c599984-f271-4886-be2f-73e7531f52e4", "tag": "54a387d8-dbe0-4a78-bbba-58f771dd4478"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:07.678499 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:40:07.678499 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:40:07.679824 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-763270cd-a19c-4224-a881-1cd19b7daac4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:07.680874 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-763270cd-a19c-4224-a881-1cd19b7daac4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:07.685659 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-5ad01b08-3a8b-49fd-9b0a-ba56fe8f875d req-723c0073-25bd-4b26-b421-725ff85ecd1b service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:07.686096 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-5ad01b08-3a8b-49fd-9b0a-ba56fe8f875d req-723c0073-25bd-4b26-b421-725ff85ecd1b service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:07.686909 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-763270cd-a19c-4224-a881-1cd19b7daac4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:07.687423 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-763270cd-a19c-4224-a881-1cd19b7daac4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:07.688396 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-763270cd-a19c-4224-a881-1cd19b7daac4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:07.688782 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-763270cd-a19c-4224-a881-1cd19b7daac4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:07.697843 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-5ad01b08-3a8b-49fd-9b0a-ba56fe8f875d req-723c0073-25bd-4b26-b421-725ff85ecd1b service nova] Creating event network-changed:54a387d8-dbe0-4a78-bbba-58f771dd4478 for instance 0c599984-f271-4886-be2f-73e7531f52e4 on hv-cinder-78239 Aug 10 03:40:07.703132 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-5ad01b08-3a8b-49fd-9b0a-ba56fe8f875d req-723c0073-25bd-4b26-b421-725ff85ecd1b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029677 Aug 10 03:40:07.704757 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 65/134] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:40:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:40:07.863098 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-763270cd-a19c-4224-a881-1cd19b7daac4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 14 microversion: 2.20 time: 0.191952 Aug 10 03:40:07.865577 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 70/135] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:07 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:08.024698 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9ccdfba9-a747-40b3-a7a4-51ccbcb43ac3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:08.028900 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9ccdfba9-a747-40b3-a7a4-51ccbcb43ac3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:08.037550 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9ccdfba9-a747-40b3-a7a4-51ccbcb43ac3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:08.038144 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9ccdfba9-a747-40b3-a7a4-51ccbcb43ac3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:08.039135 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9ccdfba9-a747-40b3-a7a4-51ccbcb43ac3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:08.039582 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9ccdfba9-a747-40b3-a7a4-51ccbcb43ac3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:08.184161 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-35447cf5-f9b6-4b3a-a155-948f15e57f4a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:08.184161 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-35447cf5-f9b6-4b3a-a155-948f15e57f4a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:08.184161 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-35447cf5-f9b6-4b3a-a155-948f15e57f4a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:08.184161 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-35447cf5-f9b6-4b3a-a155-948f15e57f4a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:08.184491 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-35447cf5-f9b6-4b3a-a155-948f15e57f4a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:08.184594 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-35447cf5-f9b6-4b3a-a155-948f15e57f4a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:08.250081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-9ccdfba9-a747-40b3-a7a4-51ccbcb43ac3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:08.259841 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9ccdfba9-a747-40b3-a7a4-51ccbcb43ac3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.242254 Aug 10 03:40:08.268626 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 66/136] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:08 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:08.378693 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-35447cf5-f9b6-4b3a-a155-948f15e57f4a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:08.386511 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-35447cf5-f9b6-4b3a-a155-948f15e57f4a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1363 microversion: 2.1 time: 0.221946 Aug 10 03:40:08.387427 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 71/137] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:08 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:08.575872 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a6026d52-b94e-4022-a1f4-2e14bfeac84e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:08.576671 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a6026d52-b94e-4022-a1f4-2e14bfeac84e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:08.592792 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a6026d52-b94e-4022-a1f4-2e14bfeac84e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:08.593627 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a6026d52-b94e-4022-a1f4-2e14bfeac84e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:08.595085 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a6026d52-b94e-4022-a1f4-2e14bfeac84e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:08.595511 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a6026d52-b94e-4022-a1f4-2e14bfeac84e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:08.631572 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a6026d52-b94e-4022-a1f4-2e14bfeac84e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Going to try to terminate instance {{(pid=108439) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:40:08.876426 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-87ab4e3c-2e5f-47d0-bb63-022ff25ac8d9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:08.877343 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-87ab4e3c-2e5f-47d0-bb63-022ff25ac8d9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:08.884474 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-87ab4e3c-2e5f-47d0-bb63-022ff25ac8d9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:08.884923 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-87ab4e3c-2e5f-47d0-bb63-022ff25ac8d9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:08.886012 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-87ab4e3c-2e5f-47d0-bb63-022ff25ac8d9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:08.886443 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-87ab4e3c-2e5f-47d0-bb63-022ff25ac8d9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:09.018482 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-87ab4e3c-2e5f-47d0-bb63-022ff25ac8d9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 14 microversion: 2.20 time: 0.146528 Aug 10 03:40:09.019058 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 72/138] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:08 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:09.100516 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a6026d52-b94e-4022-a1f4-2e14bfeac84e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "DELETE /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 204 len: 0 microversion: 2.1 time: 0.527714 Aug 10 03:40:09.107478 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 67/139] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:40:08 2021] DELETE /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:40:09.118158 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-2fe59197-89d9-4e55-9a14-3826a9038996 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:09.118849 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-2fe59197-89d9-4e55-9a14-3826a9038996 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:09.128050 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2fe59197-89d9-4e55-9a14-3826a9038996 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:09.134331 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2fe59197-89d9-4e55-9a14-3826a9038996 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:09.134331 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2fe59197-89d9-4e55-9a14-3826a9038996 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:09.134331 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2fe59197-89d9-4e55-9a14-3826a9038996 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:09.277711 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0486bb16-9bfe-41f6-bbb4-7a2554095d6f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:09.278428 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0486bb16-9bfe-41f6-bbb4-7a2554095d6f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:09.285121 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0486bb16-9bfe-41f6-bbb4-7a2554095d6f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:09.288448 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0486bb16-9bfe-41f6-bbb4-7a2554095d6f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:09.288448 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0486bb16-9bfe-41f6-bbb4-7a2554095d6f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:09.288448 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0486bb16-9bfe-41f6-bbb4-7a2554095d6f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:09.323752 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-2fe59197-89d9-4e55-9a14-3826a9038996 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:09.334800 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-2fe59197-89d9-4e55-9a14-3826a9038996 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1553 microversion: 2.1 time: 0.221017 Aug 10 03:40:09.335698 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 73/140] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:09 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1553 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:09.402711 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ec8d332e-8477-41a6-be19-39898cdb01a1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:09.403431 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ec8d332e-8477-41a6-be19-39898cdb01a1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:09.410027 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0486bb16-9bfe-41f6-bbb4-7a2554095d6f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:09.410203 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ec8d332e-8477-41a6-be19-39898cdb01a1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:09.411875 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ec8d332e-8477-41a6-be19-39898cdb01a1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:09.412114 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ec8d332e-8477-41a6-be19-39898cdb01a1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:09.412761 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ec8d332e-8477-41a6-be19-39898cdb01a1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:09.423615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0486bb16-9bfe-41f6-bbb4-7a2554095d6f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.150288 Aug 10 03:40:09.424631 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 68/141] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:09 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:09.568682 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ec8d332e-8477-41a6-be19-39898cdb01a1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:09.576187 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ec8d332e-8477-41a6-be19-39898cdb01a1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1549 microversion: 2.1 time: 0.177102 Aug 10 03:40:09.576773 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 74/142] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:09 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1549 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:09.593496 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-fb17b5d2-626f-46e5-bd26-d738963c3821 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:09.593978 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-fb17b5d2-626f-46e5-bd26-d738963c3821 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:09.600189 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fb17b5d2-626f-46e5-bd26-d738963c3821 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:09.600661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fb17b5d2-626f-46e5-bd26-d738963c3821 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:09.601422 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fb17b5d2-626f-46e5-bd26-d738963c3821 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:09.601848 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fb17b5d2-626f-46e5-bd26-d738963c3821 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:09.689119 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-fb17b5d2-626f-46e5-bd26-d738963c3821 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099378 Aug 10 03:40:09.689726 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 69/143] 10.222.0.21 () {58 vars in 1275 bytes} [Tue Aug 10 03:40:09 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:40:10.029303 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-97e1d66f-4bdd-4898-a920-4e0b1aa3a9ca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:10.032672 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-97e1d66f-4bdd-4898-a920-4e0b1aa3a9ca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:10.039562 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-97e1d66f-4bdd-4898-a920-4e0b1aa3a9ca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:10.040673 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-97e1d66f-4bdd-4898-a920-4e0b1aa3a9ca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:10.041720 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-97e1d66f-4bdd-4898-a920-4e0b1aa3a9ca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:10.042264 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-97e1d66f-4bdd-4898-a920-4e0b1aa3a9ca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:10.180276 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-97e1d66f-4bdd-4898-a920-4e0b1aa3a9ca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 14 microversion: 2.20 time: 0.154469 Aug 10 03:40:10.184029 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 75/144] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:10 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:10.356537 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-12b79252-977d-4524-84aa-91429019915e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:10.356992 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-12b79252-977d-4524-84aa-91429019915e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:10.364045 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-12b79252-977d-4524-84aa-91429019915e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:10.364598 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-12b79252-977d-4524-84aa-91429019915e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:10.365593 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-12b79252-977d-4524-84aa-91429019915e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:10.366106 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-12b79252-977d-4524-84aa-91429019915e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:10.450666 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7b24d232-6ef9-486d-ba0f-81bb0481032d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:10.452289 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7b24d232-6ef9-486d-ba0f-81bb0481032d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:10.466938 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7b24d232-6ef9-486d-ba0f-81bb0481032d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:10.469026 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7b24d232-6ef9-486d-ba0f-81bb0481032d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:10.471511 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7b24d232-6ef9-486d-ba0f-81bb0481032d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:10.472500 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7b24d232-6ef9-486d-ba0f-81bb0481032d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:10.575467 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-12b79252-977d-4524-84aa-91429019915e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:10.584648 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-12b79252-977d-4524-84aa-91429019915e tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1553 microversion: 2.1 time: 0.232177 Aug 10 03:40:10.585812 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 70/145] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:10 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:10.726499 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7b24d232-6ef9-486d-ba0f-81bb0481032d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:10.734679 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7b24d232-6ef9-486d-ba0f-81bb0481032d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.294393 Aug 10 03:40:10.738981 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 76/146] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:10 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:11.161628 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-59e3487e-5557-4a77-9f31-d23a5fc67cb1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:11.162704 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-59e3487e-5557-4a77-9f31-d23a5fc67cb1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:11.166525 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-103157db-da5f-4f67-8cc7-d2f053199413 req-77e99efe-50cd-482c-bc05-ed28fdaac486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b3a59e0-96ca-48a8-a62f-c6fef743ce89", "tag": "12cb09a3-9484-46a1-8f5c-54e53b12470c"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:11.168557 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:40:11.168557 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:40:11.177340 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-103157db-da5f-4f67-8cc7-d2f053199413 req-77e99efe-50cd-482c-bc05-ed28fdaac486 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:11.177693 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-59e3487e-5557-4a77-9f31-d23a5fc67cb1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:11.178136 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-59e3487e-5557-4a77-9f31-d23a5fc67cb1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:11.178459 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-103157db-da5f-4f67-8cc7-d2f053199413 req-77e99efe-50cd-482c-bc05-ed28fdaac486 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:11.178902 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-59e3487e-5557-4a77-9f31-d23a5fc67cb1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:11.179328 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-59e3487e-5557-4a77-9f31-d23a5fc67cb1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:11.191462 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-103157db-da5f-4f67-8cc7-d2f053199413 req-77e99efe-50cd-482c-bc05-ed28fdaac486 service nova] Creating event network-changed:12cb09a3-9484-46a1-8f5c-54e53b12470c for instance 8b3a59e0-96ca-48a8-a62f-c6fef743ce89 on hv-cinder-78239 Aug 10 03:40:11.197101 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-103157db-da5f-4f67-8cc7-d2f053199413 req-77e99efe-50cd-482c-bc05-ed28fdaac486 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035318 Aug 10 03:40:11.198047 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 77/147] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:40:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:40:11.209086 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-57643b33-37b1-4af8-bd80-5a349f972147 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:11.210583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-57643b33-37b1-4af8-bd80-5a349f972147 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:11.218632 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-57643b33-37b1-4af8-bd80-5a349f972147 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:11.219528 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-57643b33-37b1-4af8-bd80-5a349f972147 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:11.220814 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-57643b33-37b1-4af8-bd80-5a349f972147 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:11.221511 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-57643b33-37b1-4af8-bd80-5a349f972147 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:11.383139 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-59e3487e-5557-4a77-9f31-d23a5fc67cb1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.225013 Aug 10 03:40:11.383763 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 71/148] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:11 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:40:11.399375 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-57643b33-37b1-4af8-bd80-5a349f972147 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 14 microversion: 2.20 time: 0.199647 Aug 10 03:40:11.402883 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 78/149] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:11 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 14 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:11.613803 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d40ad27e-b665-41db-98f0-0bff9e9c7b81 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:11.614825 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d40ad27e-b665-41db-98f0-0bff9e9c7b81 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:11.622455 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d40ad27e-b665-41db-98f0-0bff9e9c7b81 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:11.623164 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d40ad27e-b665-41db-98f0-0bff9e9c7b81 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:11.624301 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d40ad27e-b665-41db-98f0-0bff9e9c7b81 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:11.624933 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d40ad27e-b665-41db-98f0-0bff9e9c7b81 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:11.763683 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d1322b97-0dc9-49aa-b5a4-720c5a835f5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:11.764627 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d1322b97-0dc9-49aa-b5a4-720c5a835f5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:11.771394 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d1322b97-0dc9-49aa-b5a4-720c5a835f5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:11.772304 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d1322b97-0dc9-49aa-b5a4-720c5a835f5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:11.773586 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d1322b97-0dc9-49aa-b5a4-720c5a835f5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:11.774339 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d1322b97-0dc9-49aa-b5a4-720c5a835f5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:11.865268 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d40ad27e-b665-41db-98f0-0bff9e9c7b81 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:11.879028 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d40ad27e-b665-41db-98f0-0bff9e9c7b81 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1553 microversion: 2.1 time: 0.269932 Aug 10 03:40:11.879951 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 72/150] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:11 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1553 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:12.040514 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d1322b97-0dc9-49aa-b5a4-720c5a835f5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:12.052698 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d1322b97-0dc9-49aa-b5a4-720c5a835f5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.293089 Aug 10 03:40:12.053814 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 79/151] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:11 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:12.140752 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-21504037", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452", "networks": [{"uuid": "05518596-49b6-4e96-8053-0b4e84949d5e"}]}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:12.213539 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.network.neutron [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] validate_networks() for [('05518596-49b6-4e96-8053-0b4e84949d5e', None, None, None)] {{(pid=108439) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:40:12.400707 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-32b31b06-067d-4728-baeb-b3a0f4992cb3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:12.401708 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-32b31b06-067d-4728-baeb-b3a0f4992cb3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:12.410192 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-32b31b06-067d-4728-baeb-b3a0f4992cb3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:12.412898 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-32b31b06-067d-4728-baeb-b3a0f4992cb3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:12.414446 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-32b31b06-067d-4728-baeb-b3a0f4992cb3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:12.415044 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-32b31b06-067d-4728-baeb-b3a0f4992cb3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:12.632827 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Flavor limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:40:12.634114 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Image limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:40:12.634583 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Flavor pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:40:12.634985 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Image pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:40:12.635383 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:40:12.644085 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-32b31b06-067d-4728-baeb-b3a0f4992cb3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.246958 Aug 10 03:40:12.645053 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 80/152] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:12 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 03:40:12.651072 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:12.651514 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:12.652356 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:12.652779 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:12.653272 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c96d6ec5-946f-45b0-8f43-bc7e43435fa5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:12.654366 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c96d6ec5-946f-45b0-8f43-bc7e43435fa5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:12.666052 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c96d6ec5-946f-45b0-8f43-bc7e43435fa5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:12.669392 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c96d6ec5-946f-45b0-8f43-bc7e43435fa5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:12.669392 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c96d6ec5-946f-45b0-8f43-bc7e43435fa5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:12.669392 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c96d6ec5-946f-45b0-8f43-bc7e43435fa5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:12.673632 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Getting quotas for project 0218bd23bab4457abfb072f168e61af6. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:40:12.677868 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Getting quotas for user cb4a0eaef1ba4df5a07bda5bef95dd99 and project 0218bd23bab4457abfb072f168e61af6. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:40:12.688980 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Going to run 1 instances... {{(pid=108439) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:40:12.691290 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:40:12.786875 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c96d6ec5-946f-45b0-8f43-bc7e43435fa5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 14 microversion: 2.20 time: 0.137323 Aug 10 03:40:12.787518 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 81/153] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:12 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:12.900562 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-2355f188-76fa-4e46-91d5-8699efbe7027 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:12.901953 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-2355f188-76fa-4e46-91d5-8699efbe7027 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:12.903450 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2db0b37d-e957-4b0b-b018-4aa152193cb7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769812 Aug 10 03:40:12.904490 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 73/154] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:40:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 03:40:12.915375 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-94021986-a776-4216-8689-529c49c647fb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:12.915972 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-94021986-a776-4216-8689-529c49c647fb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:12.916084 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2355f188-76fa-4e46-91d5-8699efbe7027 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:12.916458 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2355f188-76fa-4e46-91d5-8699efbe7027 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:12.918205 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2355f188-76fa-4e46-91d5-8699efbe7027 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:12.918661 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2355f188-76fa-4e46-91d5-8699efbe7027 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:13.028608 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-94021986-a776-4216-8689-529c49c647fb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:13.035679 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-94021986-a776-4216-8689-529c49c647fb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1216 microversion: 2.1 time: 0.122722 Aug 10 03:40:13.035679 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 74/155] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:12 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1216 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:13.071166 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-91d3b776-86cd-4ef8-92cd-9a34b8ad7857 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:13.072166 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-91d3b776-86cd-4ef8-92cd-9a34b8ad7857 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:13.081018 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-91d3b776-86cd-4ef8-92cd-9a34b8ad7857 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:13.082107 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-91d3b776-86cd-4ef8-92cd-9a34b8ad7857 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:13.083048 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-91d3b776-86cd-4ef8-92cd-9a34b8ad7857 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:13.083718 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-91d3b776-86cd-4ef8-92cd-9a34b8ad7857 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:13.222228 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-2355f188-76fa-4e46-91d5-8699efbe7027 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:13.230173 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-2355f188-76fa-4e46-91d5-8699efbe7027 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1553 microversion: 2.1 time: 0.336590 Aug 10 03:40:13.241533 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 82/156] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:12 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1553 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:13.255814 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-91d3b776-86cd-4ef8-92cd-9a34b8ad7857 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:13.263300 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-91d3b776-86cd-4ef8-92cd-9a34b8ad7857 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.197841 Aug 10 03:40:13.264054 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 75/157] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:13 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:13.412162 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-1d160903-2a61-4cf2-a0c0-5eacdbbe1c6c req-eb3699b3-efaa-4b4e-a1ff-52c8e92ea7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b15c91-649d-46ab-8a83-0af955b0034c", "name": "network-vif-deleted", "tag": "de122834-5f01-4a99-9143-529a113b3416"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:13.416753 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:40:13.416753 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:40:13.427577 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-1d160903-2a61-4cf2-a0c0-5eacdbbe1c6c req-eb3699b3-efaa-4b4e-a1ff-52c8e92ea7c4 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:13.435734 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-1d160903-2a61-4cf2-a0c0-5eacdbbe1c6c req-eb3699b3-efaa-4b4e-a1ff-52c8e92ea7c4 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:13.441559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-1d160903-2a61-4cf2-a0c0-5eacdbbe1c6c req-eb3699b3-efaa-4b4e-a1ff-52c8e92ea7c4 service nova] Creating event network-vif-deleted:de122834-5f01-4a99-9143-529a113b3416 for instance 11b15c91-649d-46ab-8a83-0af955b0034c on hv-cinder-78239 Aug 10 03:40:13.446595 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-1d160903-2a61-4cf2-a0c0-5eacdbbe1c6c req-eb3699b3-efaa-4b4e-a1ff-52c8e92ea7c4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038144 Aug 10 03:40:13.447608 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 83/158] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:40:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:40:13.655037 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a6ba511a-9fbf-499c-a4e0-1076624eb682 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:13.655599 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a6ba511a-9fbf-499c-a4e0-1076624eb682 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:13.662120 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a6ba511a-9fbf-499c-a4e0-1076624eb682 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:13.662525 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a6ba511a-9fbf-499c-a4e0-1076624eb682 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:13.663426 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a6ba511a-9fbf-499c-a4e0-1076624eb682 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:13.663717 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a6ba511a-9fbf-499c-a4e0-1076624eb682 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:13.798947 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3407a3e5-e0a1-475e-9ee7-cc7d42ca0523 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:13.800220 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3407a3e5-e0a1-475e-9ee7-cc7d42ca0523 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:13.803645 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a6ba511a-9fbf-499c-a4e0-1076624eb682 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.152403 Aug 10 03:40:13.804316 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 76/159] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:13 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:40:13.806395 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3407a3e5-e0a1-475e-9ee7-cc7d42ca0523 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:13.806832 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3407a3e5-e0a1-475e-9ee7-cc7d42ca0523 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:13.807590 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3407a3e5-e0a1-475e-9ee7-cc7d42ca0523 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:13.808010 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3407a3e5-e0a1-475e-9ee7-cc7d42ca0523 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:13.918661 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3407a3e5-e0a1-475e-9ee7-cc7d42ca0523 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 14 microversion: 2.20 time: 0.123724 Aug 10 03:40:13.919271 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 84/160] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:13 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:14.050323 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-bba5a249-c9ad-4336-b609-29d15648c2f6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:14.051017 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-bba5a249-c9ad-4336-b609-29d15648c2f6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:14.103258 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bba5a249-c9ad-4336-b609-29d15648c2f6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:14.122130 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-bba5a249-c9ad-4336-b609-29d15648c2f6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1216 microversion: 2.1 time: 0.063549 Aug 10 03:40:14.122130 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 77/161] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:14 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1216 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:14.248224 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d3299195-2d88-473b-ab6b-2f2f03e6689a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:14.248935 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d3299195-2d88-473b-ab6b-2f2f03e6689a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:14.255700 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d3299195-2d88-473b-ab6b-2f2f03e6689a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:14.256142 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d3299195-2d88-473b-ab6b-2f2f03e6689a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:14.257015 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d3299195-2d88-473b-ab6b-2f2f03e6689a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:14.257443 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d3299195-2d88-473b-ab6b-2f2f03e6689a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:14.281379 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d7d7b659-7c41-4721-b6de-4dca85709c5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:14.283064 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d7d7b659-7c41-4721-b6de-4dca85709c5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:14.290908 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d7d7b659-7c41-4721-b6de-4dca85709c5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:14.296020 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d7d7b659-7c41-4721-b6de-4dca85709c5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:14.296020 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d7d7b659-7c41-4721-b6de-4dca85709c5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:14.296020 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d7d7b659-7c41-4721-b6de-4dca85709c5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:14.326549 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d3299195-2d88-473b-ab6b-2f2f03e6689a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:14.335861 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d3299195-2d88-473b-ab6b-2f2f03e6689a tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1346 microversion: 2.1 time: 0.091510 Aug 10 03:40:14.336551 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 85/162] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:14 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:14.434035 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d7d7b659-7c41-4721-b6de-4dca85709c5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:14.442460 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d7d7b659-7c41-4721-b6de-4dca85709c5b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.165714 Aug 10 03:40:14.443026 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 78/163] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:14 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:14.816776 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0935c85f-4856-46b7-8514-f0355e5c7d8f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:14.817273 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0935c85f-4856-46b7-8514-f0355e5c7d8f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:14.830286 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0935c85f-4856-46b7-8514-f0355e5c7d8f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:14.832856 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0935c85f-4856-46b7-8514-f0355e5c7d8f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:14.833716 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0935c85f-4856-46b7-8514-f0355e5c7d8f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:14.834149 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0935c85f-4856-46b7-8514-f0355e5c7d8f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:14.929771 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-609ca01f-f876-48b5-a067-7f3c44a44cd9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:14.930749 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-609ca01f-f876-48b5-a067-7f3c44a44cd9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:14.937123 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-609ca01f-f876-48b5-a067-7f3c44a44cd9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:14.937856 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-609ca01f-f876-48b5-a067-7f3c44a44cd9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:14.938656 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-609ca01f-f876-48b5-a067-7f3c44a44cd9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:14.939258 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-609ca01f-f876-48b5-a067-7f3c44a44cd9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:14.947745 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0935c85f-4856-46b7-8514-f0355e5c7d8f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.136036 Aug 10 03:40:14.949235 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 86/164] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:14 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:40:15.068050 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-609ca01f-f876-48b5-a067-7f3c44a44cd9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 14 microversion: 2.20 time: 0.142129 Aug 10 03:40:15.068735 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 79/165] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:14 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:15.127655 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-44b16ad5-16e1-47e8-bf88-75134cbfba66 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:15.128367 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-44b16ad5-16e1-47e8-bf88-75134cbfba66 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:15.135200 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44b16ad5-16e1-47e8-bf88-75134cbfba66 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:15.135633 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44b16ad5-16e1-47e8-bf88-75134cbfba66 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:15.136516 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44b16ad5-16e1-47e8-bf88-75134cbfba66 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:15.136966 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44b16ad5-16e1-47e8-bf88-75134cbfba66 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:15.199804 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-44b16ad5-16e1-47e8-bf88-75134cbfba66 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:15.207749 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-44b16ad5-16e1-47e8-bf88-75134cbfba66 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1212 microversion: 2.1 time: 0.084410 Aug 10 03:40:15.208424 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 87/166] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:15 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:15.353832 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-36ce4571-036d-4e96-a4a7-e7b416597489 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:15.354503 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-36ce4571-036d-4e96-a4a7-e7b416597489 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:15.361501 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36ce4571-036d-4e96-a4a7-e7b416597489 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:15.361947 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36ce4571-036d-4e96-a4a7-e7b416597489 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:15.362737 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36ce4571-036d-4e96-a4a7-e7b416597489 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:15.363179 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36ce4571-036d-4e96-a4a7-e7b416597489 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:15.395384 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36ce4571-036d-4e96-a4a7-e7b416597489 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:15.395821 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36ce4571-036d-4e96-a4a7-e7b416597489 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:15.396286 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-36ce4571-036d-4e96-a4a7-e7b416597489 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lazy-loading 'fault' on Instance uuid 11b15c91-649d-46ab-8a83-0af955b0034c {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:40:15.439404 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-36ce4571-036d-4e96-a4a7-e7b416597489 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b063b3c1f344f5818b55f29b349571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02cb87684af34e389239670bfe0eb2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:15.447154 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-36ce4571-036d-4e96-a4a7-e7b416597489 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 200 len: 1351 microversion: 2.1 time: 0.097399 Aug 10 03:40:15.447706 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 80/167] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:15 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:15.459916 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f0613860-e273-4085-bbcc-62da3d6ad7b1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:15.460983 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f0613860-e273-4085-bbcc-62da3d6ad7b1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:15.467220 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f0613860-e273-4085-bbcc-62da3d6ad7b1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:15.467876 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f0613860-e273-4085-bbcc-62da3d6ad7b1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:15.469008 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f0613860-e273-4085-bbcc-62da3d6ad7b1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:15.469721 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f0613860-e273-4085-bbcc-62da3d6ad7b1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:15.605763 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f0613860-e273-4085-bbcc-62da3d6ad7b1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:15.615039 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f0613860-e273-4085-bbcc-62da3d6ad7b1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.159150 Aug 10 03:40:15.615614 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 88/168] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:15 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:15.959544 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3047ecd6-459f-4eff-9f23-33fea687df74 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:15.960480 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3047ecd6-459f-4eff-9f23-33fea687df74 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:15.966276 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3047ecd6-459f-4eff-9f23-33fea687df74 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:15.966658 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3047ecd6-459f-4eff-9f23-33fea687df74 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:15.967415 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3047ecd6-459f-4eff-9f23-33fea687df74 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:15.967844 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3047ecd6-459f-4eff-9f23-33fea687df74 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:16.079431 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3a3d81aa-cc99-4a70-8072-60eb9430cf96 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:16.080575 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3a3d81aa-cc99-4a70-8072-60eb9430cf96 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:16.086905 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3a3d81aa-cc99-4a70-8072-60eb9430cf96 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:16.087371 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3a3d81aa-cc99-4a70-8072-60eb9430cf96 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:16.088138 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3a3d81aa-cc99-4a70-8072-60eb9430cf96 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:16.088622 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3a3d81aa-cc99-4a70-8072-60eb9430cf96 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:16.093758 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3047ecd6-459f-4eff-9f23-33fea687df74 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.137694 Aug 10 03:40:16.094506 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 81/169] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:15 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:40:16.221936 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3a3d81aa-cc99-4a70-8072-60eb9430cf96 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 14 microversion: 2.20 time: 0.146602 Aug 10 03:40:16.222607 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 89/170] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:16 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:16.236317 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-045266d2-16b3-4212-a9ac-c399e0f188f7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:16.236317 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-045266d2-16b3-4212-a9ac-c399e0f188f7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:16.242712 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-045266d2-16b3-4212-a9ac-c399e0f188f7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:16.243287 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-045266d2-16b3-4212-a9ac-c399e0f188f7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:16.248451 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-045266d2-16b3-4212-a9ac-c399e0f188f7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:16.249161 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-045266d2-16b3-4212-a9ac-c399e0f188f7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:16.311939 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-045266d2-16b3-4212-a9ac-c399e0f188f7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:16.319654 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-045266d2-16b3-4212-a9ac-c399e0f188f7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1268 microversion: 2.1 time: 0.092232 Aug 10 03:40:16.320229 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 82/171] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:16 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1268 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:16.468905 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-43f9e9fa-b9e8-49dc-b764-ac9d715593fa tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:16.469900 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-43f9e9fa-b9e8-49dc-b764-ac9d715593fa tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:16.476949 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43f9e9fa-b9e8-49dc-b764-ac9d715593fa tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:16.477579 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43f9e9fa-b9e8-49dc-b764-ac9d715593fa tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:16.478818 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43f9e9fa-b9e8-49dc-b764-ac9d715593fa tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:16.479434 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43f9e9fa-b9e8-49dc-b764-ac9d715593fa tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:16.496406 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-43f9e9fa-b9e8-49dc-b764-ac9d715593fa tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] HTTP exception thrown: Instance 11b15c91-649d-46ab-8a83-0af955b0034c could not be found. Aug 10 03:40:16.497197 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-43f9e9fa-b9e8-49dc-b764-ac9d715593fa tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Returning 404 to user: Instance 11b15c91-649d-46ab-8a83-0af955b0034c could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:40:16.498191 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-43f9e9fa-b9e8-49dc-b764-ac9d715593fa tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 404 len: 111 microversion: 2.1 time: 0.036054 Aug 10 03:40:16.498735 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 90/172] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:16 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:40:16.616557 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-328708d9-b050-4527-ab39-777b4318ca45 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:16.617469 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-328708d9-b050-4527-ab39-777b4318ca45 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:16.623214 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-328708d9-b050-4527-ab39-777b4318ca45 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:16.623660 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-328708d9-b050-4527-ab39-777b4318ca45 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:16.627975 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-328708d9-b050-4527-ab39-777b4318ca45 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:16.627975 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-328708d9-b050-4527-ab39-777b4318ca45 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:16.634944 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3af51bf3-d995-438b-b943-58d8fc5bd556 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:16.635905 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3af51bf3-d995-438b-b943-58d8fc5bd556 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:16.640531 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-328708d9-b050-4527-ab39-777b4318ca45 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] HTTP exception thrown: Instance 11b15c91-649d-46ab-8a83-0af955b0034c could not be found. Aug 10 03:40:16.641217 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-328708d9-b050-4527-ab39-777b4318ca45 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Returning 404 to user: Instance 11b15c91-649d-46ab-8a83-0af955b0034c could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:40:16.642312 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-328708d9-b050-4527-ab39-777b4318ca45 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029712 Aug 10 03:40:16.643117 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3af51bf3-d995-438b-b943-58d8fc5bd556 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:16.644060 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3af51bf3-d995-438b-b943-58d8fc5bd556 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:16.645379 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3af51bf3-d995-438b-b943-58d8fc5bd556 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:16.646172 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3af51bf3-d995-438b-b943-58d8fc5bd556 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:16.654498 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 83/173] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:40:16 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:40:16.792290 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3af51bf3-d995-438b-b943-58d8fc5bd556 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:16.799935 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3af51bf3-d995-438b-b943-58d8fc5bd556 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.170449 Aug 10 03:40:16.800523 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 91/174] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:16 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:17.104800 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-74b35eaf-15bd-4f60-bf91-f06c2428b1ab tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:17.105806 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-74b35eaf-15bd-4f60-bf91-f06c2428b1ab tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:17.117251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-74b35eaf-15bd-4f60-bf91-f06c2428b1ab tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:17.122233 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-74b35eaf-15bd-4f60-bf91-f06c2428b1ab tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:17.122233 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-74b35eaf-15bd-4f60-bf91-f06c2428b1ab tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:17.122233 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-74b35eaf-15bd-4f60-bf91-f06c2428b1ab tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:17.235764 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-50739acd-e7ba-4ac1-9429-04404ec8a427 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:17.237166 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-50739acd-e7ba-4ac1-9429-04404ec8a427 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:17.250536 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-50739acd-e7ba-4ac1-9429-04404ec8a427 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:17.250624 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-74b35eaf-15bd-4f60-bf91-f06c2428b1ab tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.143310 Aug 10 03:40:17.250698 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-50739acd-e7ba-4ac1-9429-04404ec8a427 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:17.250698 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-50739acd-e7ba-4ac1-9429-04404ec8a427 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:17.250698 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-50739acd-e7ba-4ac1-9429-04404ec8a427 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:17.250886 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 84/175] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:17 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 03:40:17.338870 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d1891c1c-558b-450b-a0ee-95e37ed3deee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:17.339971 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d1891c1c-558b-450b-a0ee-95e37ed3deee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:17.347337 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d1891c1c-558b-450b-a0ee-95e37ed3deee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:17.348267 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d1891c1c-558b-450b-a0ee-95e37ed3deee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:17.349011 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d1891c1c-558b-450b-a0ee-95e37ed3deee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:17.349864 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d1891c1c-558b-450b-a0ee-95e37ed3deee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:17.372574 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-50739acd-e7ba-4ac1-9429-04404ec8a427 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 14 microversion: 2.20 time: 0.141686 Aug 10 03:40:17.374506 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 92/176] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:17 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:17.447501 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d1891c1c-558b-450b-a0ee-95e37ed3deee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:17.457613 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d1891c1c-558b-450b-a0ee-95e37ed3deee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1286 microversion: 2.1 time: 0.123935 Aug 10 03:40:17.460284 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 85/177] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:17 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:17.820661 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3c2a9242-6e70-40d1-9812-f2edb6707c0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:17.821350 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3c2a9242-6e70-40d1-9812-f2edb6707c0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:17.827934 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3c2a9242-6e70-40d1-9812-f2edb6707c0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:17.828429 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3c2a9242-6e70-40d1-9812-f2edb6707c0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:17.829217 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3c2a9242-6e70-40d1-9812-f2edb6707c0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:17.829638 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3c2a9242-6e70-40d1-9812-f2edb6707c0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:18.040421 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3c2a9242-6e70-40d1-9812-f2edb6707c0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:18.051597 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3c2a9242-6e70-40d1-9812-f2edb6707c0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.235034 Aug 10 03:40:18.061023 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 93/178] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:17 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:18.071819 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-36aa25f3-c819-455e-85a1-0a6d9673a042 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:18.077114 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-36aa25f3-c819-455e-85a1-0a6d9673a042 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:18.079372 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36aa25f3-c819-455e-85a1-0a6d9673a042 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:18.079833 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36aa25f3-c819-455e-85a1-0a6d9673a042 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:18.080617 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36aa25f3-c819-455e-85a1-0a6d9673a042 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:18.081046 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36aa25f3-c819-455e-85a1-0a6d9673a042 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:18.117300 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-36aa25f3-c819-455e-85a1-0a6d9673a042 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] HTTP exception thrown: Instance 11b15c91-649d-46ab-8a83-0af955b0034c could not be found. Aug 10 03:40:18.117979 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-36aa25f3-c819-455e-85a1-0a6d9673a042 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Returning 404 to user: Instance 11b15c91-649d-46ab-8a83-0af955b0034c could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:40:18.118929 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-36aa25f3-c819-455e-85a1-0a6d9673a042 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "DELETE /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 404 len: 111 microversion: 2.1 time: 0.050864 Aug 10 03:40:18.125859 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 86/179] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:40:18 2021] DELETE /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:40:18.135784 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f663eb2d-7d29-4233-9525-a9c6309165c6 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:18.136508 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f663eb2d-7d29-4233-9525-a9c6309165c6 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] [instance: 11b15c91-649d-46ab-8a83-0af955b0034c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:18.147729 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f663eb2d-7d29-4233-9525-a9c6309165c6 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:18.148682 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f663eb2d-7d29-4233-9525-a9c6309165c6 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:18.149293 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f663eb2d-7d29-4233-9525-a9c6309165c6 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:18.150136 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f663eb2d-7d29-4233-9525-a9c6309165c6 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:18.172894 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-f663eb2d-7d29-4233-9525-a9c6309165c6 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] HTTP exception thrown: Instance 11b15c91-649d-46ab-8a83-0af955b0034c could not be found. Aug 10 03:40:18.173716 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f663eb2d-7d29-4233-9525-a9c6309165c6 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] Returning 404 to user: Instance 11b15c91-649d-46ab-8a83-0af955b0034c could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:40:18.174789 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f663eb2d-7d29-4233-9525-a9c6309165c6 tempest-DeleteServersTestJSON-1031712448 tempest-DeleteServersTestJSON-1031712448-project] 10.222.0.21 "GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c" status: 404 len: 111 microversion: 2.1 time: 0.043803 Aug 10 03:40:18.175817 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 94/180] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:18 2021] GET /compute/v2.1/servers/11b15c91-649d-46ab-8a83-0af955b0034c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:40:18.258763 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5931989c-560d-45ca-8259-1f359b32cac4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:18.260340 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-5931989c-560d-45ca-8259-1f359b32cac4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:18.278188 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5931989c-560d-45ca-8259-1f359b32cac4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:18.280556 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5931989c-560d-45ca-8259-1f359b32cac4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:18.286132 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5931989c-560d-45ca-8259-1f359b32cac4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:18.286615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5931989c-560d-45ca-8259-1f359b32cac4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:18.386888 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-5c1aa49e-da4f-41d2-914b-67565d512f04 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:18.389755 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-5c1aa49e-da4f-41d2-914b-67565d512f04 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:18.396479 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5c1aa49e-da4f-41d2-914b-67565d512f04 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:18.397075 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5c1aa49e-da4f-41d2-914b-67565d512f04 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:18.398072 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5c1aa49e-da4f-41d2-914b-67565d512f04 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:18.398621 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5c1aa49e-da4f-41d2-914b-67565d512f04 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:18.453367 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5931989c-560d-45ca-8259-1f359b32cac4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.200249 Aug 10 03:40:18.458222 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 87/181] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:18 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:40:18.474744 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-fafea3d1-8e94-4f08-8fda-41544cb15589 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:18.475447 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-fafea3d1-8e94-4f08-8fda-41544cb15589 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:18.482306 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fafea3d1-8e94-4f08-8fda-41544cb15589 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:18.482751 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fafea3d1-8e94-4f08-8fda-41544cb15589 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:18.483542 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fafea3d1-8e94-4f08-8fda-41544cb15589 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:18.483943 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fafea3d1-8e94-4f08-8fda-41544cb15589 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:18.534597 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-5c1aa49e-da4f-41d2-914b-67565d512f04 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 14 microversion: 2.20 time: 0.152644 Aug 10 03:40:18.536594 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 95/182] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:18 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:18.706354 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-fafea3d1-8e94-4f08-8fda-41544cb15589 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:18.714272 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-fafea3d1-8e94-4f08-8fda-41544cb15589 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1316 microversion: 2.1 time: 0.243532 Aug 10 03:40:18.722343 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 88/183] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:18 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:19.073036 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-801093b2-ba76-4b03-ba1e-994aa0ec1e62 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:19.073733 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-801093b2-ba76-4b03-ba1e-994aa0ec1e62 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:19.082190 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-801093b2-ba76-4b03-ba1e-994aa0ec1e62 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:19.082905 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-801093b2-ba76-4b03-ba1e-994aa0ec1e62 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:19.083939 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-801093b2-ba76-4b03-ba1e-994aa0ec1e62 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:19.084653 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-801093b2-ba76-4b03-ba1e-994aa0ec1e62 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:19.234243 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-801093b2-ba76-4b03-ba1e-994aa0ec1e62 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:19.242521 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-801093b2-ba76-4b03-ba1e-994aa0ec1e62 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.176649 Aug 10 03:40:19.243593 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 96/184] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:19 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:19.465728 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b8ab0014-b0cb-401c-97d8-1f0ea3b5238f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:19.466629 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b8ab0014-b0cb-401c-97d8-1f0ea3b5238f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:19.472351 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b8ab0014-b0cb-401c-97d8-1f0ea3b5238f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:19.472794 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b8ab0014-b0cb-401c-97d8-1f0ea3b5238f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:19.473545 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b8ab0014-b0cb-401c-97d8-1f0ea3b5238f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:19.473969 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b8ab0014-b0cb-401c-97d8-1f0ea3b5238f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:19.550625 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-9cff6552-44c0-481c-8b49-5747b87daada tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:19.552017 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-9cff6552-44c0-481c-8b49-5747b87daada tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:19.558739 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9cff6552-44c0-481c-8b49-5747b87daada tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:19.559273 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9cff6552-44c0-481c-8b49-5747b87daada tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:19.560075 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9cff6552-44c0-481c-8b49-5747b87daada tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:19.560531 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9cff6552-44c0-481c-8b49-5747b87daada tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:19.580968 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b8ab0014-b0cb-401c-97d8-1f0ea3b5238f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.119076 Aug 10 03:40:19.584425 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 89/185] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:19 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:40:19.692840 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-9cff6552-44c0-481c-8b49-5747b87daada tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 14 microversion: 2.20 time: 0.148725 Aug 10 03:40:19.693558 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 97/186] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:19 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:19.732479 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-89bee298-0982-4d08-8fc6-fc62791233ba tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:19.733202 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-89bee298-0982-4d08-8fc6-fc62791233ba tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:19.740670 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-89bee298-0982-4d08-8fc6-fc62791233ba tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:19.741110 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-89bee298-0982-4d08-8fc6-fc62791233ba tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:19.741872 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-89bee298-0982-4d08-8fc6-fc62791233ba tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:19.742303 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-89bee298-0982-4d08-8fc6-fc62791233ba tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:19.864971 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-89bee298-0982-4d08-8fc6-fc62791233ba tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:19.872834 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-89bee298-0982-4d08-8fc6-fc62791233ba tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1316 microversion: 2.1 time: 0.144302 Aug 10 03:40:19.873409 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 90/187] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:19 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1316 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:19.928229 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-fdf334b4-07d8-43af-b561-ef311be0f0cb req-55eff37e-48e5-4ea5-8746-e889271d343e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f213fc94-e730-4eb5-9e17-14f69627cc4f", "tag": "f709d076-13f8-4646-b744-12a5c0e99aa7"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:19.930049 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:40:19.930049 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:40:19.937903 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-fdf334b4-07d8-43af-b561-ef311be0f0cb req-55eff37e-48e5-4ea5-8746-e889271d343e service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:19.938441 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-fdf334b4-07d8-43af-b561-ef311be0f0cb req-55eff37e-48e5-4ea5-8746-e889271d343e service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:19.957559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-fdf334b4-07d8-43af-b561-ef311be0f0cb req-55eff37e-48e5-4ea5-8746-e889271d343e service nova] Creating event network-changed:f709d076-13f8-4646-b744-12a5c0e99aa7 for instance f213fc94-e730-4eb5-9e17-14f69627cc4f on hv-cinder-78239 Aug 10 03:40:19.962680 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-fdf334b4-07d8-43af-b561-ef311be0f0cb req-55eff37e-48e5-4ea5-8746-e889271d343e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039091 Aug 10 03:40:19.963276 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 98/188] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:40:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:40:20.262744 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2c7cdd66-949e-441d-8501-7b804871a3fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:20.263975 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2c7cdd66-949e-441d-8501-7b804871a3fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:20.272662 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2c7cdd66-949e-441d-8501-7b804871a3fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:20.273707 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2c7cdd66-949e-441d-8501-7b804871a3fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:20.275242 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2c7cdd66-949e-441d-8501-7b804871a3fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:20.276007 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2c7cdd66-949e-441d-8501-7b804871a3fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:20.447751 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2c7cdd66-949e-441d-8501-7b804871a3fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:20.456786 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2c7cdd66-949e-441d-8501-7b804871a3fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.199758 Aug 10 03:40:20.457597 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 91/189] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:20 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:20.591432 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0174155e-0573-47fd-9dc5-102917fc4928 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:20.592491 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0174155e-0573-47fd-9dc5-102917fc4928 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:20.599131 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0174155e-0573-47fd-9dc5-102917fc4928 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:20.599572 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0174155e-0573-47fd-9dc5-102917fc4928 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:20.600827 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0174155e-0573-47fd-9dc5-102917fc4928 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:20.601289 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0174155e-0573-47fd-9dc5-102917fc4928 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:20.703346 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a98b848c-308f-46a8-8c4e-4b93db723824 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:20.704268 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a98b848c-308f-46a8-8c4e-4b93db723824 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:20.710022 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a98b848c-308f-46a8-8c4e-4b93db723824 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:20.710458 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a98b848c-308f-46a8-8c4e-4b93db723824 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:20.711211 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a98b848c-308f-46a8-8c4e-4b93db723824 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:20.711636 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a98b848c-308f-46a8-8c4e-4b93db723824 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:20.726397 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0174155e-0573-47fd-9dc5-102917fc4928 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.138652 Aug 10 03:40:20.726988 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 99/190] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:20 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:40:20.805593 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a98b848c-308f-46a8-8c4e-4b93db723824 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 14 microversion: 2.20 time: 0.105998 Aug 10 03:40:20.806217 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 92/191] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:20 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:20.890528 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-72aac412-5af4-45e5-9445-5844370eaa1e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:20.891270 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-72aac412-5af4-45e5-9445-5844370eaa1e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:20.898181 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72aac412-5af4-45e5-9445-5844370eaa1e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:20.898765 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72aac412-5af4-45e5-9445-5844370eaa1e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:20.899684 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72aac412-5af4-45e5-9445-5844370eaa1e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:20.900155 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72aac412-5af4-45e5-9445-5844370eaa1e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:21.020970 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-72aac412-5af4-45e5-9445-5844370eaa1e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:21.028185 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-72aac412-5af4-45e5-9445-5844370eaa1e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1316 microversion: 2.1 time: 0.141945 Aug 10 03:40:21.028770 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 100/192] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:20 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1316 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:21.475955 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-fc3813a6-ecfc-4a94-8d16-aabcacb51377 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:21.476695 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-fc3813a6-ecfc-4a94-8d16-aabcacb51377 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:21.483317 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fc3813a6-ecfc-4a94-8d16-aabcacb51377 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:21.483697 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fc3813a6-ecfc-4a94-8d16-aabcacb51377 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:21.484552 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fc3813a6-ecfc-4a94-8d16-aabcacb51377 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:21.485559 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fc3813a6-ecfc-4a94-8d16-aabcacb51377 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:21.645478 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-fc3813a6-ecfc-4a94-8d16-aabcacb51377 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:21.653689 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-fc3813a6-ecfc-4a94-8d16-aabcacb51377 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.181614 Aug 10 03:40:21.654976 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 93/193] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:21 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:21.737595 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a05aa7dd-efac-4796-8c0f-3725bce3942f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:21.738471 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a05aa7dd-efac-4796-8c0f-3725bce3942f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:21.744378 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a05aa7dd-efac-4796-8c0f-3725bce3942f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:21.744822 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a05aa7dd-efac-4796-8c0f-3725bce3942f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:21.745581 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a05aa7dd-efac-4796-8c0f-3725bce3942f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:21.746008 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a05aa7dd-efac-4796-8c0f-3725bce3942f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:21.816628 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-596f736b-bebb-4038-a477-b7a59a91f9c9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:21.817471 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-596f736b-bebb-4038-a477-b7a59a91f9c9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:21.823436 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-596f736b-bebb-4038-a477-b7a59a91f9c9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:21.823882 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-596f736b-bebb-4038-a477-b7a59a91f9c9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:21.824661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-596f736b-bebb-4038-a477-b7a59a91f9c9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:21.825090 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-596f736b-bebb-4038-a477-b7a59a91f9c9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:21.851836 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a05aa7dd-efac-4796-8c0f-3725bce3942f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.118052 Aug 10 03:40:21.852490 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 101/194] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:21 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 03:40:21.946626 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-596f736b-bebb-4038-a477-b7a59a91f9c9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 14 microversion: 2.20 time: 0.133659 Aug 10 03:40:21.947400 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 94/195] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:21 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:22.045495 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-67a89411-e4f9-453a-8914-109bcf0695df tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:22.046191 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-67a89411-e4f9-453a-8914-109bcf0695df tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:22.053471 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-67a89411-e4f9-453a-8914-109bcf0695df tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:22.053921 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-67a89411-e4f9-453a-8914-109bcf0695df tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:22.054686 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-67a89411-e4f9-453a-8914-109bcf0695df tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:22.055278 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-67a89411-e4f9-453a-8914-109bcf0695df tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:22.181950 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-67a89411-e4f9-453a-8914-109bcf0695df tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:22.206723 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-67a89411-e4f9-453a-8914-109bcf0695df tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1316 microversion: 2.1 time: 0.165071 Aug 10 03:40:22.212757 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 102/196] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:22 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:22.675274 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-aaee6d97-c4ba-4eb7-a3b2-0f81308850c5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:22.676036 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-aaee6d97-c4ba-4eb7-a3b2-0f81308850c5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:22.682680 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aaee6d97-c4ba-4eb7-a3b2-0f81308850c5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:22.683113 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aaee6d97-c4ba-4eb7-a3b2-0f81308850c5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:22.683901 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aaee6d97-c4ba-4eb7-a3b2-0f81308850c5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:22.684449 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aaee6d97-c4ba-4eb7-a3b2-0f81308850c5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:22.815439 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-aaee6d97-c4ba-4eb7-a3b2-0f81308850c5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:22.823121 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-aaee6d97-c4ba-4eb7-a3b2-0f81308850c5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.155449 Aug 10 03:40:22.824333 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 95/197] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:22 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:22.864239 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-74f18644-2469-4f33-82db-e96725aeacff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:22.865561 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-74f18644-2469-4f33-82db-e96725aeacff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:22.871721 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-74f18644-2469-4f33-82db-e96725aeacff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:22.872169 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-74f18644-2469-4f33-82db-e96725aeacff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:22.872979 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-74f18644-2469-4f33-82db-e96725aeacff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:22.873413 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-74f18644-2469-4f33-82db-e96725aeacff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:22.958406 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1d1680ef-fd28-4ab2-85f5-d010dc63ae7c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:22.959311 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1d1680ef-fd28-4ab2-85f5-d010dc63ae7c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:22.965307 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1d1680ef-fd28-4ab2-85f5-d010dc63ae7c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:22.966007 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1d1680ef-fd28-4ab2-85f5-d010dc63ae7c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:22.966504 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1d1680ef-fd28-4ab2-85f5-d010dc63ae7c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:22.966923 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1d1680ef-fd28-4ab2-85f5-d010dc63ae7c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:23.003157 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-74f18644-2469-4f33-82db-e96725aeacff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.143901 Aug 10 03:40:23.004051 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 103/198] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:22 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:40:23.073121 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1d1680ef-fd28-4ab2-85f5-d010dc63ae7c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 14 microversion: 2.20 time: 0.118259 Aug 10 03:40:23.073726 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 96/199] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:22 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:23.227189 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-72c83a23-5e5d-40c5-bee4-8dc524140b0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:23.227401 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-72c83a23-5e5d-40c5-bee4-8dc524140b0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:23.233970 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72c83a23-5e5d-40c5-bee4-8dc524140b0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:23.234415 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72c83a23-5e5d-40c5-bee4-8dc524140b0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:23.235184 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72c83a23-5e5d-40c5-bee4-8dc524140b0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:23.235616 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72c83a23-5e5d-40c5-bee4-8dc524140b0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:23.372864 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-72c83a23-5e5d-40c5-bee4-8dc524140b0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:23.380444 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-72c83a23-5e5d-40c5-bee4-8dc524140b0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1316 microversion: 2.1 time: 0.157777 Aug 10 03:40:23.381036 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 104/200] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:23 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:23.844968 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0abca945-518d-4269-8ffb-a5e103882c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:23.845690 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0abca945-518d-4269-8ffb-a5e103882c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:23.852118 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0abca945-518d-4269-8ffb-a5e103882c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:23.857632 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0abca945-518d-4269-8ffb-a5e103882c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:23.857632 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0abca945-518d-4269-8ffb-a5e103882c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:23.857632 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0abca945-518d-4269-8ffb-a5e103882c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:23.978563 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0abca945-518d-4269-8ffb-a5e103882c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:23.986616 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0abca945-518d-4269-8ffb-a5e103882c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.145814 Aug 10 03:40:23.987176 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 97/201] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:23 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:24.013162 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c1171432-1f3f-4f16-83e3-fb4281cc386d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:24.014062 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c1171432-1f3f-4f16-83e3-fb4281cc386d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:24.019792 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1171432-1f3f-4f16-83e3-fb4281cc386d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:24.023977 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1171432-1f3f-4f16-83e3-fb4281cc386d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:24.023977 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1171432-1f3f-4f16-83e3-fb4281cc386d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:24.023977 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1171432-1f3f-4f16-83e3-fb4281cc386d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:24.083217 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-bba8395b-3c69-437f-9eb2-9ef4d676e40a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:24.084679 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-bba8395b-3c69-437f-9eb2-9ef4d676e40a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:24.091766 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bba8395b-3c69-437f-9eb2-9ef4d676e40a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:24.091766 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bba8395b-3c69-437f-9eb2-9ef4d676e40a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:24.091766 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bba8395b-3c69-437f-9eb2-9ef4d676e40a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:24.094097 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bba8395b-3c69-437f-9eb2-9ef4d676e40a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:24.129627 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c1171432-1f3f-4f16-83e3-fb4281cc386d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.119779 Aug 10 03:40:24.130835 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 105/202] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:24 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:40:24.227297 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-bba8395b-3c69-437f-9eb2-9ef4d676e40a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 14 microversion: 2.20 time: 0.147550 Aug 10 03:40:24.230612 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 98/203] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:24 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:24.397525 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-9522e8fe-540c-459f-befd-6a9eda594319 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:24.398253 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-9522e8fe-540c-459f-befd-6a9eda594319 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:24.408975 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9522e8fe-540c-459f-befd-6a9eda594319 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:24.409533 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9522e8fe-540c-459f-befd-6a9eda594319 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:24.410395 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9522e8fe-540c-459f-befd-6a9eda594319 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:24.411033 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9522e8fe-540c-459f-befd-6a9eda594319 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:24.547135 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9522e8fe-540c-459f-befd-6a9eda594319 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:24.554408 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-9522e8fe-540c-459f-befd-6a9eda594319 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1316 microversion: 2.1 time: 0.160832 Aug 10 03:40:24.554967 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 106/204] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:24 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:25.003742 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e969f380-779f-49ad-8e72-2ab0e7672b65 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:25.004541 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e969f380-779f-49ad-8e72-2ab0e7672b65 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:25.011008 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e969f380-779f-49ad-8e72-2ab0e7672b65 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:25.011469 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e969f380-779f-49ad-8e72-2ab0e7672b65 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:25.012249 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e969f380-779f-49ad-8e72-2ab0e7672b65 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:25.012695 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e969f380-779f-49ad-8e72-2ab0e7672b65 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:25.141681 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e969f380-779f-49ad-8e72-2ab0e7672b65 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:25.145490 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-879bd871-7512-4523-8e3f-dfff46e4780e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:25.146634 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-879bd871-7512-4523-8e3f-dfff46e4780e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:25.150664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e969f380-779f-49ad-8e72-2ab0e7672b65 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.151469 Aug 10 03:40:25.151401 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 99/205] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:24 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:25.160340 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-879bd871-7512-4523-8e3f-dfff46e4780e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:25.160340 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-879bd871-7512-4523-8e3f-dfff46e4780e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:25.160340 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-879bd871-7512-4523-8e3f-dfff46e4780e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:25.160340 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-879bd871-7512-4523-8e3f-dfff46e4780e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:25.237516 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-34c750e9-67f5-4487-9965-ad905dfdbb1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:25.238412 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-34c750e9-67f5-4487-9965-ad905dfdbb1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:25.244532 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-34c750e9-67f5-4487-9965-ad905dfdbb1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:25.244925 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-34c750e9-67f5-4487-9965-ad905dfdbb1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:25.245678 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-34c750e9-67f5-4487-9965-ad905dfdbb1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:25.246119 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-34c750e9-67f5-4487-9965-ad905dfdbb1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:25.271138 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-879bd871-7512-4523-8e3f-dfff46e4780e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.130003 Aug 10 03:40:25.271761 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 107/206] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:25 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 03:40:25.376011 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-34c750e9-67f5-4487-9965-ad905dfdbb1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 7357 microversion: 2.20 time: 0.141567 Aug 10 03:40:25.376686 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 100/207] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:25 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 7357 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:40:25.572120 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7e94b0a0-6589-4c60-badb-d38895be4667 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:25.572752 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7e94b0a0-6589-4c60-badb-d38895be4667 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:25.579435 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7e94b0a0-6589-4c60-badb-d38895be4667 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:25.579871 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7e94b0a0-6589-4c60-badb-d38895be4667 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:25.580657 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7e94b0a0-6589-4c60-badb-d38895be4667 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:25.581083 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7e94b0a0-6589-4c60-badb-d38895be4667 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:25.709219 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7e94b0a0-6589-4c60-badb-d38895be4667 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:25.716559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7e94b0a0-6589-4c60-badb-d38895be4667 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1316 microversion: 2.1 time: 0.148530 Aug 10 03:40:25.717437 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 108/208] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:25 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:26.168413 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2bb2a340-2fd5-43a4-b2e9-3bed661cdeb8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:26.169022 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2bb2a340-2fd5-43a4-b2e9-3bed661cdeb8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:26.175357 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2bb2a340-2fd5-43a4-b2e9-3bed661cdeb8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:26.175795 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2bb2a340-2fd5-43a4-b2e9-3bed661cdeb8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:26.176589 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2bb2a340-2fd5-43a4-b2e9-3bed661cdeb8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:26.177013 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2bb2a340-2fd5-43a4-b2e9-3bed661cdeb8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:26.282294 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8700e519-2cca-4d35-8095-cc7f6dac0c36 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:26.283207 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8700e519-2cca-4d35-8095-cc7f6dac0c36 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:26.288957 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8700e519-2cca-4d35-8095-cc7f6dac0c36 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:26.289400 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8700e519-2cca-4d35-8095-cc7f6dac0c36 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:26.290179 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8700e519-2cca-4d35-8095-cc7f6dac0c36 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:26.290592 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8700e519-2cca-4d35-8095-cc7f6dac0c36 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:26.305182 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2bb2a340-2fd5-43a4-b2e9-3bed661cdeb8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:26.312522 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2bb2a340-2fd5-43a4-b2e9-3bed661cdeb8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.148310 Aug 10 03:40:26.313163 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 101/209] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:26 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:26.390302 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-90311efa-8e27-4201-957d-558409deff04 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:26.390302 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-90311efa-8e27-4201-957d-558409deff04 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:26.394212 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8700e519-2cca-4d35-8095-cc7f6dac0c36 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.116024 Aug 10 03:40:26.395251 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 109/210] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:26 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:40:26.395364 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-90311efa-8e27-4201-957d-558409deff04 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:26.396053 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-90311efa-8e27-4201-957d-558409deff04 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:26.396875 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-90311efa-8e27-4201-957d-558409deff04 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:26.397384 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-90311efa-8e27-4201-957d-558409deff04 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:26.513040 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-90311efa-8e27-4201-957d-558409deff04 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 12367 microversion: 2.20 time: 0.129760 Aug 10 03:40:26.513656 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 102/211] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:26 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 12367 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:40:26.735218 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ff6ba1d3-9677-4257-a0e7-afb6c44409f9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:26.736181 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ff6ba1d3-9677-4257-a0e7-afb6c44409f9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:26.743635 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff6ba1d3-9677-4257-a0e7-afb6c44409f9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:26.744148 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff6ba1d3-9677-4257-a0e7-afb6c44409f9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:26.745135 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff6ba1d3-9677-4257-a0e7-afb6c44409f9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:26.745678 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff6ba1d3-9677-4257-a0e7-afb6c44409f9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:26.873369 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ff6ba1d3-9677-4257-a0e7-afb6c44409f9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:26.881219 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ff6ba1d3-9677-4257-a0e7-afb6c44409f9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1316 microversion: 2.1 time: 0.150973 Aug 10 03:40:26.881807 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 110/212] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:26 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:27.338089 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-323eb68a-04cf-4fe1-b4db-e894ebaf25cf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:27.338858 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-323eb68a-04cf-4fe1-b4db-e894ebaf25cf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:27.345715 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-323eb68a-04cf-4fe1-b4db-e894ebaf25cf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:27.346151 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-323eb68a-04cf-4fe1-b4db-e894ebaf25cf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:27.346958 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-323eb68a-04cf-4fe1-b4db-e894ebaf25cf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:27.347444 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-323eb68a-04cf-4fe1-b4db-e894ebaf25cf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:27.405053 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-36fa6e13-9827-4ef5-8cb6-d1931191b36b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:27.405960 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-36fa6e13-9827-4ef5-8cb6-d1931191b36b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:27.411902 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-36fa6e13-9827-4ef5-8cb6-d1931191b36b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:27.412387 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-36fa6e13-9827-4ef5-8cb6-d1931191b36b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:27.413355 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-36fa6e13-9827-4ef5-8cb6-d1931191b36b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:27.413789 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-36fa6e13-9827-4ef5-8cb6-d1931191b36b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:27.478058 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-323eb68a-04cf-4fe1-b4db-e894ebaf25cf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:27.485305 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-323eb68a-04cf-4fe1-b4db-e894ebaf25cf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.151620 Aug 10 03:40:27.486364 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 103/213] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:27 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:27.509234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-36fa6e13-9827-4ef5-8cb6-d1931191b36b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.107716 Aug 10 03:40:27.509850 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 111/214] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:27 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 03:40:27.524397 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-36082943-0b93-4ef5-bc77-6fdf3120571b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:27.525292 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-36082943-0b93-4ef5-bc77-6fdf3120571b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:27.533925 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36082943-0b93-4ef5-bc77-6fdf3120571b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:27.533925 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36082943-0b93-4ef5-bc77-6fdf3120571b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:27.533925 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36082943-0b93-4ef5-bc77-6fdf3120571b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:27.533925 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36082943-0b93-4ef5-bc77-6fdf3120571b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:27.647130 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-36082943-0b93-4ef5-bc77-6fdf3120571b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 17354 microversion: 2.20 time: 0.126274 Aug 10 03:40:27.647808 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 104/215] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:27 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 17354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:40:27.898417 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a93fbe4b-3919-4243-9d55-4e74a822f7a7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:27.899124 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a93fbe4b-3919-4243-9d55-4e74a822f7a7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:27.905626 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a93fbe4b-3919-4243-9d55-4e74a822f7a7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:27.906072 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a93fbe4b-3919-4243-9d55-4e74a822f7a7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:27.906843 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a93fbe4b-3919-4243-9d55-4e74a822f7a7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:27.907270 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a93fbe4b-3919-4243-9d55-4e74a822f7a7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:27.979126 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-35af0d5a-78f6-438f-aba0-5b9bcdbeff6e req-c07fab41-48e3-4cfb-8396-d9611425838c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f213fc94-e730-4eb5-9e17-14f69627cc4f", "name": "network-vif-plugged", "status": "completed", "tag": "f709d076-13f8-4646-b744-12a5c0e99aa7"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:27.980855 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:40:27.980855 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:40:27.991688 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-35af0d5a-78f6-438f-aba0-5b9bcdbeff6e req-c07fab41-48e3-4cfb-8396-d9611425838c service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:27.991807 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-35af0d5a-78f6-438f-aba0-5b9bcdbeff6e req-c07fab41-48e3-4cfb-8396-d9611425838c service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:28.004581 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-35af0d5a-78f6-438f-aba0-5b9bcdbeff6e req-c07fab41-48e3-4cfb-8396-d9611425838c service nova] Creating event network-vif-plugged:f709d076-13f8-4646-b744-12a5c0e99aa7 for instance f213fc94-e730-4eb5-9e17-14f69627cc4f on hv-cinder-78239 Aug 10 03:40:28.009572 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-35af0d5a-78f6-438f-aba0-5b9bcdbeff6e req-c07fab41-48e3-4cfb-8396-d9611425838c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036213 Aug 10 03:40:28.010689 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 105/216] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:40:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:40:28.034035 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a93fbe4b-3919-4243-9d55-4e74a822f7a7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:28.041968 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a93fbe4b-3919-4243-9d55-4e74a822f7a7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1316 microversion: 2.1 time: 0.147652 Aug 10 03:40:28.042516 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 112/217] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:27 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1316 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:28.505843 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e3ed3943-58a4-4455-9b6b-e1d9dcd0d927 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:28.506531 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e3ed3943-58a4-4455-9b6b-e1d9dcd0d927 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:28.512655 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3ed3943-58a4-4455-9b6b-e1d9dcd0d927 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:28.513089 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3ed3943-58a4-4455-9b6b-e1d9dcd0d927 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:28.513866 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3ed3943-58a4-4455-9b6b-e1d9dcd0d927 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:28.514290 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3ed3943-58a4-4455-9b6b-e1d9dcd0d927 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:28.519735 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-db9516bd-f67f-46a4-8ffb-bc44dc95977a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:28.520655 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-db9516bd-f67f-46a4-8ffb-bc44dc95977a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:28.526338 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-db9516bd-f67f-46a4-8ffb-bc44dc95977a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:28.526779 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-db9516bd-f67f-46a4-8ffb-bc44dc95977a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:28.527583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-db9516bd-f67f-46a4-8ffb-bc44dc95977a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:28.527971 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-db9516bd-f67f-46a4-8ffb-bc44dc95977a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:28.641248 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e3ed3943-58a4-4455-9b6b-e1d9dcd0d927 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:28.648475 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e3ed3943-58a4-4455-9b6b-e1d9dcd0d927 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.146734 Aug 10 03:40:28.649034 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 106/218] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:28 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:28.657432 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1e7be994-5131-4efb-9349-23bd23636f14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:28.658313 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1e7be994-5131-4efb-9349-23bd23636f14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:28.663867 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e7be994-5131-4efb-9349-23bd23636f14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:28.664506 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e7be994-5131-4efb-9349-23bd23636f14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:28.665255 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e7be994-5131-4efb-9349-23bd23636f14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:28.665678 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e7be994-5131-4efb-9349-23bd23636f14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:28.952462 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-db9516bd-f67f-46a4-8ffb-bc44dc95977a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 14 microversion: 2.1 time: 0.436244 Aug 10 03:40:28.953454 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 113/219] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:28 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 14 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 03:40:29.060989 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4f7afc5d-df91-4c1f-be44-7ed437131ded tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:29.061721 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4f7afc5d-df91-4c1f-be44-7ed437131ded tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:29.068260 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4f7afc5d-df91-4c1f-be44-7ed437131ded tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:29.068707 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4f7afc5d-df91-4c1f-be44-7ed437131ded tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:29.069625 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4f7afc5d-df91-4c1f-be44-7ed437131ded tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:29.070058 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4f7afc5d-df91-4c1f-be44-7ed437131ded tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:29.208286 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-4f7afc5d-df91-4c1f-be44-7ed437131ded tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:29.217185 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4f7afc5d-df91-4c1f-be44-7ed437131ded tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1316 microversion: 2.1 time: 0.160235 Aug 10 03:40:29.217920 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 114/220] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:29 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:29.665030 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8d168768-a31c-4e65-9912-2f605a03dcbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:29.665654 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8d168768-a31c-4e65-9912-2f605a03dcbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:29.671376 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8d168768-a31c-4e65-9912-2f605a03dcbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:29.671815 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8d168768-a31c-4e65-9912-2f605a03dcbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:29.673348 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8d168768-a31c-4e65-9912-2f605a03dcbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:29.673773 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8d168768-a31c-4e65-9912-2f605a03dcbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:29.799678 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-8d168768-a31c-4e65-9912-2f605a03dcbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:29.809108 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8d168768-a31c-4e65-9912-2f605a03dcbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.147697 Aug 10 03:40:29.816777 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 115/221] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:29 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:29.962878 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a1d5657b-b12d-424e-a534-c7924030b44b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:29.963853 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a1d5657b-b12d-424e-a534-c7924030b44b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:29.970562 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a1d5657b-b12d-424e-a534-c7924030b44b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:29.971003 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a1d5657b-b12d-424e-a534-c7924030b44b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:29.972008 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a1d5657b-b12d-424e-a534-c7924030b44b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:29.972686 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a1d5657b-b12d-424e-a534-c7924030b44b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:32.102358 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1e7be994-5131-4efb-9349-23bd23636f14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 22540 microversion: 2.20 time: 3.275392 Aug 10 03:40:32.102358 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 107/222] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:28 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 22540 bytes in 3277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:40:32.102358 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-10c102bb-b25f-410c-8194-d27a7e4dfdef tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:32.102358 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-10c102bb-b25f-410c-8194-d27a7e4dfdef tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:32.102358 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-10c102bb-b25f-410c-8194-d27a7e4dfdef tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:32.105006 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-10c102bb-b25f-410c-8194-d27a7e4dfdef tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:32.105006 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-10c102bb-b25f-410c-8194-d27a7e4dfdef tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:32.105006 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-10c102bb-b25f-410c-8194-d27a7e4dfdef tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:32.105245 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a1d5657b-b12d-424e-a534-c7924030b44b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 15025 microversion: 2.1 time: 2.081352 Aug 10 03:40:32.105245 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 116/223] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:29 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 15025 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:40:32.105245 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7a349510-5f9f-43b8-a645-7e8d6c7749b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:32.105245 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7a349510-5f9f-43b8-a645-7e8d6c7749b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:32.105245 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7a349510-5f9f-43b8-a645-7e8d6c7749b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:32.105920 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7a349510-5f9f-43b8-a645-7e8d6c7749b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:32.105920 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7a349510-5f9f-43b8-a645-7e8d6c7749b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:32.105920 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7a349510-5f9f-43b8-a645-7e8d6c7749b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:32.189042 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7a349510-5f9f-43b8-a645-7e8d6c7749b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:32.196502 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7a349510-5f9f-43b8-a645-7e8d6c7749b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.153917 Aug 10 03:40:32.197067 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 117/224] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:32 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:32.224562 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-10c102bb-b25f-410c-8194-d27a7e4dfdef tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:32.224562 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-10c102bb-b25f-410c-8194-d27a7e4dfdef tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1316 microversion: 2.1 time: 0.288744 Aug 10 03:40:32.224562 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 108/225] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:31 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:33.120959 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5bbb4334-a558-4a9e-b331-49277e824114 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:33.121960 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-5bbb4334-a558-4a9e-b331-49277e824114 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:33.129228 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5bbb4334-a558-4a9e-b331-49277e824114 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:33.129880 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5bbb4334-a558-4a9e-b331-49277e824114 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:33.130586 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5bbb4334-a558-4a9e-b331-49277e824114 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:33.131084 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5bbb4334-a558-4a9e-b331-49277e824114 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:33.131485 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c0e35d5b-cec0-43c1-8984-4687384ca988 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:33.132446 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c0e35d5b-cec0-43c1-8984-4687384ca988 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:33.139746 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c0e35d5b-cec0-43c1-8984-4687384ca988 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:33.140470 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c0e35d5b-cec0-43c1-8984-4687384ca988 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:33.141514 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c0e35d5b-cec0-43c1-8984-4687384ca988 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:33.142120 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c0e35d5b-cec0-43c1-8984-4687384ca988 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:33.279457 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5bbb4334-a558-4a9e-b331-49277e824114 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 17686 microversion: 2.1 time: 0.161862 Aug 10 03:40:33.281051 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 109/226] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:33 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 17686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:40:33.285054 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ff78a2dc-3909-46ce-940f-4ad9772e04f9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:33.285756 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ff78a2dc-3909-46ce-940f-4ad9772e04f9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:33.292117 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ff78a2dc-3909-46ce-940f-4ad9772e04f9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:33.292589 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ff78a2dc-3909-46ce-940f-4ad9772e04f9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:33.293347 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ff78a2dc-3909-46ce-940f-4ad9772e04f9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:33.293772 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ff78a2dc-3909-46ce-940f-4ad9772e04f9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:33.333269 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c0e35d5b-cec0-43c1-8984-4687384ca988 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 23792 microversion: 2.20 time: 0.212145 Aug 10 03:40:33.333269 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 118/227] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:33 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 23792 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:40:33.334002 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8a3d2668-9ce2-40f8-9db6-9bdc1e01517c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:33.334616 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8a3d2668-9ce2-40f8-9db6-9bdc1e01517c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:33.341480 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8a3d2668-9ce2-40f8-9db6-9bdc1e01517c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:33.341917 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8a3d2668-9ce2-40f8-9db6-9bdc1e01517c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:33.342684 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8a3d2668-9ce2-40f8-9db6-9bdc1e01517c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:33.343114 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8a3d2668-9ce2-40f8-9db6-9bdc1e01517c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:33.420914 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ff78a2dc-3909-46ce-940f-4ad9772e04f9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:33.428667 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ff78a2dc-3909-46ce-940f-4ad9772e04f9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.147265 Aug 10 03:40:33.429315 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 110/228] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:33 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:33.474587 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-8a3d2668-9ce2-40f8-9db6-9bdc1e01517c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:33.482645 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8a3d2668-9ce2-40f8-9db6-9bdc1e01517c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1316 microversion: 2.1 time: 0.153322 Aug 10 03:40:33.488379 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 119/229] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:33 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:34.290874 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-043897df-9f90-4fc4-b374-9c290895d35a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:34.291968 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-043897df-9f90-4fc4-b374-9c290895d35a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:34.298516 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-043897df-9f90-4fc4-b374-9c290895d35a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:34.299040 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-043897df-9f90-4fc4-b374-9c290895d35a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:34.299892 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-043897df-9f90-4fc4-b374-9c290895d35a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:34.300458 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-043897df-9f90-4fc4-b374-9c290895d35a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:34.342979 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-150e2cd4-3012-4a70-8a93-d2b0db0eda8d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:34.343884 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-150e2cd4-3012-4a70-8a93-d2b0db0eda8d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:34.350125 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-150e2cd4-3012-4a70-8a93-d2b0db0eda8d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:34.350572 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-150e2cd4-3012-4a70-8a93-d2b0db0eda8d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:34.351333 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-150e2cd4-3012-4a70-8a93-d2b0db0eda8d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:34.351765 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-150e2cd4-3012-4a70-8a93-d2b0db0eda8d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:34.447804 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-043897df-9f90-4fc4-b374-9c290895d35a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 17931 microversion: 2.1 time: 0.160343 Aug 10 03:40:34.448495 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 111/230] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:34 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 17931 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:40:34.460325 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-14e8cd66-3053-4ced-b1f7-c2748479f144 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:34.461292 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-14e8cd66-3053-4ced-b1f7-c2748479f144 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:34.467582 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-14e8cd66-3053-4ced-b1f7-c2748479f144 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:34.468515 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-14e8cd66-3053-4ced-b1f7-c2748479f144 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:34.469293 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-14e8cd66-3053-4ced-b1f7-c2748479f144 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:34.469883 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-14e8cd66-3053-4ced-b1f7-c2748479f144 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:34.479079 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-150e2cd4-3012-4a70-8a93-d2b0db0eda8d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 24573 microversion: 2.20 time: 0.139440 Aug 10 03:40:34.481007 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 120/231] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:34 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 24573 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:40:34.507826 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7cf896da-3618-4bc6-aa58-abce0ba017af tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:34.507826 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7cf896da-3618-4bc6-aa58-abce0ba017af tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:34.515221 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7cf896da-3618-4bc6-aa58-abce0ba017af tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:34.516311 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7cf896da-3618-4bc6-aa58-abce0ba017af tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:34.517369 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7cf896da-3618-4bc6-aa58-abce0ba017af tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:34.517972 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7cf896da-3618-4bc6-aa58-abce0ba017af tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:34.609837 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-14e8cd66-3053-4ced-b1f7-c2748479f144 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:34.618118 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-14e8cd66-3053-4ced-b1f7-c2748479f144 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.167614 Aug 10 03:40:34.618816 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 112/232] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:34 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:34.655676 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7cf896da-3618-4bc6-aa58-abce0ba017af tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:34.662894 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7cf896da-3618-4bc6-aa58-abce0ba017af tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1506 microversion: 2.1 time: 0.164629 Aug 10 03:40:34.663450 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 121/233] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:34 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:34.694944 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-cbc49544-7a7a-42f4-950a-3279a54653b8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1374aed3-40a8-44e1-a84e-89ca17489689"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:34.696086 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-cbc49544-7a7a-42f4-950a-3279a54653b8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:34.702097 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cbc49544-7a7a-42f4-950a-3279a54653b8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:34.702534 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cbc49544-7a7a-42f4-950a-3279a54653b8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:34.703289 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cbc49544-7a7a-42f4-950a-3279a54653b8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:34.703712 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cbc49544-7a7a-42f4-950a-3279a54653b8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:34.789627 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-cbc49544-7a7a-42f4-950a-3279a54653b8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] HTTP exception thrown: Invalid volume: volume 1374aed3-40a8-44e1-a84e-89ca17489689 is already attached to instances: 3a912ff3-ac1a-4d82-971a-be7ebb16c176 Aug 10 03:40:34.791481 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-cbc49544-7a7a-42f4-950a-3279a54653b8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Returning 400 to user: Invalid volume: volume 1374aed3-40a8-44e1-a84e-89ca17489689 is already attached to instances: 3a912ff3-ac1a-4d82-971a-be7ebb16c176 {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:40:34.791481 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-cbc49544-7a7a-42f4-950a-3279a54653b8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "POST /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100230 Aug 10 03:40:34.792626 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 113/234] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 10 03:40:34 2021] POST /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 03:40:34.866561 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-fa9c4ebf-885c-4231-accd-7a91fb7e3718 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:34.867037 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-fa9c4ebf-885c-4231-accd-7a91fb7e3718 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:34.872679 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fa9c4ebf-885c-4231-accd-7a91fb7e3718 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:34.873120 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fa9c4ebf-885c-4231-accd-7a91fb7e3718 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:34.873923 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fa9c4ebf-885c-4231-accd-7a91fb7e3718 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:34.874347 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fa9c4ebf-885c-4231-accd-7a91fb7e3718 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:35.020031 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-fa9c4ebf-885c-4231-accd-7a91fb7e3718 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lazy-loading 'services' on Instance uuid 3a912ff3-ac1a-4d82-971a-be7ebb16c176 {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:40:35.459160 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-94448d45-1b7b-4f5b-b166-07aac446378d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:35.460130 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-94448d45-1b7b-4f5b-b166-07aac446378d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:35.467386 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94448d45-1b7b-4f5b-b166-07aac446378d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:35.467829 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94448d45-1b7b-4f5b-b166-07aac446378d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:35.468615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94448d45-1b7b-4f5b-b166-07aac446378d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:35.469572 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94448d45-1b7b-4f5b-b166-07aac446378d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:35.490096 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-fa9c4ebf-885c-4231-accd-7a91fb7e3718 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176/os-volume_attachments/1374aed3-40a8-44e1-a84e-89ca17489689" status: 202 len: 0 microversion: 2.1 time: 0.627118 Aug 10 03:40:35.493452 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 122/235] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 10 03:40:34 2021] DELETE /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176/os-volume_attachments/1374aed3-40a8-44e1-a84e-89ca17489689 => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:40:35.503824 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b2320304-6cbd-46a2-9915-0318ce01ade0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:35.504901 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b2320304-6cbd-46a2-9915-0318ce01ade0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:35.511052 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b2320304-6cbd-46a2-9915-0318ce01ade0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:35.511619 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b2320304-6cbd-46a2-9915-0318ce01ade0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:35.512428 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b2320304-6cbd-46a2-9915-0318ce01ade0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:35.512850 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b2320304-6cbd-46a2-9915-0318ce01ade0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:35.623659 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-94448d45-1b7b-4f5b-b166-07aac446378d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 20193 microversion: 2.1 time: 0.168026 Aug 10 03:40:35.627598 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 114/236] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:35 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 20193 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:40:35.629383 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6ce3b7d9-e808-41ea-b5e4-165f3837376f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:35.630430 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6ce3b7d9-e808-41ea-b5e4-165f3837376f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:35.636950 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6ce3b7d9-e808-41ea-b5e4-165f3837376f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:35.637391 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6ce3b7d9-e808-41ea-b5e4-165f3837376f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:35.638149 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6ce3b7d9-e808-41ea-b5e4-165f3837376f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:35.638577 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6ce3b7d9-e808-41ea-b5e4-165f3837376f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:35.668629 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6ce3b7d9-e808-41ea-b5e4-165f3837376f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043072 Aug 10 03:40:35.669192 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 115/237] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:40:35 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:40:35.676452 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-92e714f1-e0bc-4efb-b316-54f6d092d290 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:35.677081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-92e714f1-e0bc-4efb-b316-54f6d092d290 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:35.680709 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b2320304-6cbd-46a2-9915-0318ce01ade0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 25616 microversion: 2.20 time: 0.181637 Aug 10 03:40:35.681381 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 123/238] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:35 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 25616 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:40:35.682949 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-92e714f1-e0bc-4efb-b316-54f6d092d290 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:35.683399 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-92e714f1-e0bc-4efb-b316-54f6d092d290 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:35.684172 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-92e714f1-e0bc-4efb-b316-54f6d092d290 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:35.684627 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-92e714f1-e0bc-4efb-b316-54f6d092d290 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:35.812492 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-92e714f1-e0bc-4efb-b316-54f6d092d290 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:35.819656 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-92e714f1-e0bc-4efb-b316-54f6d092d290 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.149557 Aug 10 03:40:35.820219 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 116/239] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:35 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:36.635429 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-eba00f10-2137-4f7f-85d1-bf0fcf15e3ea tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:36.636543 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-eba00f10-2137-4f7f-85d1-bf0fcf15e3ea tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:36.643427 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-eba00f10-2137-4f7f-85d1-bf0fcf15e3ea tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:36.643938 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-eba00f10-2137-4f7f-85d1-bf0fcf15e3ea tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:36.644872 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-eba00f10-2137-4f7f-85d1-bf0fcf15e3ea tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:36.645476 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-eba00f10-2137-4f7f-85d1-bf0fcf15e3ea tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:36.680372 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9193af04-cd72-43d4-b57c-b27dc1b9dd3f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:36.681328 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9193af04-cd72-43d4-b57c-b27dc1b9dd3f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:36.687536 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9193af04-cd72-43d4-b57c-b27dc1b9dd3f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:36.688075 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9193af04-cd72-43d4-b57c-b27dc1b9dd3f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:36.688952 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9193af04-cd72-43d4-b57c-b27dc1b9dd3f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:36.689449 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9193af04-cd72-43d4-b57c-b27dc1b9dd3f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:36.718673 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9193af04-cd72-43d4-b57c-b27dc1b9dd3f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042275 Aug 10 03:40:36.719857 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 117/240] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:40:36 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:40:36.724112 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b8d9d7e2-66f4-4409-a7e3-e09f02174eaa tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:36.725147 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b8d9d7e2-66f4-4409-a7e3-e09f02174eaa tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:36.730696 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b8d9d7e2-66f4-4409-a7e3-e09f02174eaa tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:36.731138 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b8d9d7e2-66f4-4409-a7e3-e09f02174eaa tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:36.731891 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b8d9d7e2-66f4-4409-a7e3-e09f02174eaa tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:36.732356 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b8d9d7e2-66f4-4409-a7e3-e09f02174eaa tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:36.764046 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-eba00f10-2137-4f7f-85d1-bf0fcf15e3ea tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 21972 microversion: 2.1 time: 0.132234 Aug 10 03:40:36.764794 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 124/241] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:36 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 21972 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:40:36.835733 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1efc2757-fee9-4d23-9db1-3e1febe61e3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:36.836474 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1efc2757-fee9-4d23-9db1-3e1febe61e3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:36.842878 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1efc2757-fee9-4d23-9db1-3e1febe61e3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:36.843325 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1efc2757-fee9-4d23-9db1-3e1febe61e3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:36.844822 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1efc2757-fee9-4d23-9db1-3e1febe61e3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:36.845184 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1efc2757-fee9-4d23-9db1-3e1febe61e3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:36.849204 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b8d9d7e2-66f4-4409-a7e3-e09f02174eaa tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 26334 microversion: 2.20 time: 0.128088 Aug 10 03:40:36.849924 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 118/242] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:36 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 26334 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:40:36.967697 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1efc2757-fee9-4d23-9db1-3e1febe61e3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:36.975874 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1efc2757-fee9-4d23-9db1-3e1febe61e3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.144065 Aug 10 03:40:36.976479 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 125/243] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:36 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:37.731866 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-54893b6a-b937-434c-a5c0-8f7fc8d38faa tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:37.733038 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-54893b6a-b937-434c-a5c0-8f7fc8d38faa tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:37.740091 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54893b6a-b937-434c-a5c0-8f7fc8d38faa tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:37.740607 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54893b6a-b937-434c-a5c0-8f7fc8d38faa tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:37.741429 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54893b6a-b937-434c-a5c0-8f7fc8d38faa tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:37.742010 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54893b6a-b937-434c-a5c0-8f7fc8d38faa tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:37.775022 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f6a0a426-b175-4dde-a03f-efe29b07404a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:37.775920 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f6a0a426-b175-4dde-a03f-efe29b07404a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:37.782233 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6a0a426-b175-4dde-a03f-efe29b07404a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:37.782669 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6a0a426-b175-4dde-a03f-efe29b07404a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:37.783423 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6a0a426-b175-4dde-a03f-efe29b07404a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:37.783812 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-54893b6a-b937-434c-a5c0-8f7fc8d38faa tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056793 Aug 10 03:40:37.783928 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6a0a426-b175-4dde-a03f-efe29b07404a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:37.784402 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 119/244] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:40:37 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:40:37.861282 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f599eff6-a068-4836-8b90-d0cf3e220edb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:37.862217 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f599eff6-a068-4836-8b90-d0cf3e220edb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:37.868030 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f599eff6-a068-4836-8b90-d0cf3e220edb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:37.868503 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f599eff6-a068-4836-8b90-d0cf3e220edb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:37.869254 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f599eff6-a068-4836-8b90-d0cf3e220edb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:37.869680 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f599eff6-a068-4836-8b90-d0cf3e220edb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:37.900703 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f6a0a426-b175-4dde-a03f-efe29b07404a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 23138 microversion: 2.1 time: 0.129340 Aug 10 03:40:37.901331 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 126/245] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:37 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 23138 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:40:37.987722 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f599eff6-a068-4836-8b90-d0cf3e220edb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 27099 microversion: 2.20 time: 0.130242 Aug 10 03:40:37.988471 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 120/246] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:37 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 27099 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:40:37.994383 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-61a2e1bc-2500-4676-a0f7-173c4e67f192 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:37.995086 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-61a2e1bc-2500-4676-a0f7-173c4e67f192 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:38.002078 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-61a2e1bc-2500-4676-a0f7-173c4e67f192 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:38.002523 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-61a2e1bc-2500-4676-a0f7-173c4e67f192 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:38.003291 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-61a2e1bc-2500-4676-a0f7-173c4e67f192 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:38.003722 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-61a2e1bc-2500-4676-a0f7-173c4e67f192 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:38.144603 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-61a2e1bc-2500-4676-a0f7-173c4e67f192 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:38.151771 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-61a2e1bc-2500-4676-a0f7-173c4e67f192 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.161430 Aug 10 03:40:38.152848 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 127/247] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:37 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:38.795673 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-277b468e-b3c7-41de-8a11-ba2edaebecc9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:38.796684 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-277b468e-b3c7-41de-8a11-ba2edaebecc9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:38.803332 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-277b468e-b3c7-41de-8a11-ba2edaebecc9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:38.803772 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-277b468e-b3c7-41de-8a11-ba2edaebecc9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:38.804642 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-277b468e-b3c7-41de-8a11-ba2edaebecc9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:38.805065 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-277b468e-b3c7-41de-8a11-ba2edaebecc9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:38.835890 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-277b468e-b3c7-41de-8a11-ba2edaebecc9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044293 Aug 10 03:40:38.836544 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 121/248] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:40:38 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:40:38.912346 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7c9d4976-367e-422f-b3f7-677316183c5f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:38.913461 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7c9d4976-367e-422f-b3f7-677316183c5f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:38.919072 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c9d4976-367e-422f-b3f7-677316183c5f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:38.919502 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c9d4976-367e-422f-b3f7-677316183c5f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:38.920612 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c9d4976-367e-422f-b3f7-677316183c5f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:38.921041 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c9d4976-367e-422f-b3f7-677316183c5f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:38.998835 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f33d3401-6da6-4367-9ce0-a1185044ca1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:38.999740 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f33d3401-6da6-4367-9ce0-a1185044ca1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:39.006222 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f33d3401-6da6-4367-9ce0-a1185044ca1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:39.006664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f33d3401-6da6-4367-9ce0-a1185044ca1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:39.007441 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f33d3401-6da6-4367-9ce0-a1185044ca1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:39.007860 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f33d3401-6da6-4367-9ce0-a1185044ca1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:39.030480 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7c9d4976-367e-422f-b3f7-677316183c5f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 23802 microversion: 2.1 time: 0.121994 Aug 10 03:40:39.031843 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 128/249] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:38 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 23802 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:40:39.074327 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-260883869", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452", "networks": [{"uuid": "05518596-49b6-4e96-8053-0b4e84949d5e"}]}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:39.119441 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f33d3401-6da6-4367-9ce0-a1185044ca1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 27636 microversion: 2.20 time: 0.124265 Aug 10 03:40:39.120146 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 122/250] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:38 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 27636 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:40:39.126384 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.network.neutron [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] validate_networks() for [('05518596-49b6-4e96-8053-0b4e84949d5e', None, None, None)] {{(pid=108440) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:40:39.169021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-7c8b6b02-4449-404a-b908-11f58eb87907 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:39.169711 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-7c8b6b02-4449-404a-b908-11f58eb87907 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:39.176761 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7c8b6b02-4449-404a-b908-11f58eb87907 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:39.177222 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7c8b6b02-4449-404a-b908-11f58eb87907 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:39.177988 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7c8b6b02-4449-404a-b908-11f58eb87907 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:39.178414 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7c8b6b02-4449-404a-b908-11f58eb87907 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:39.311250 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-7c8b6b02-4449-404a-b908-11f58eb87907 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:39.319823 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-7c8b6b02-4449-404a-b908-11f58eb87907 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.154772 Aug 10 03:40:39.329168 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 123/251] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:39 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:39.427291 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-234119725", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452", "networks": [{"uuid": "ecebe461-ac2a-4cc3-81e9-d8b51a7bb890"}]}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:39.479958 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.network.neutron [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] validate_networks() for [('ecebe461-ac2a-4cc3-81e9-d8b51a7bb890', None, None, None)] {{(pid=108439) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:40:39.542429 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Flavor limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:40:39.542909 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Image limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:40:39.543407 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Flavor pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:40:39.543808 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Image pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:40:39.544262 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:40:39.552907 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:39.553346 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:39.554223 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:39.554646 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:39.571260 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Getting quotas for project 0218bd23bab4457abfb072f168e61af6. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:40:39.575026 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Getting quotas for user cb4a0eaef1ba4df5a07bda5bef95dd99 and project 0218bd23bab4457abfb072f168e61af6. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:40:39.586302 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Going to run 1 instances... {{(pid=108440) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:40:39.588889 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:40:39.786011 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6a564fd6-c8dc-4a20-90b6-21cacb36972b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715691 Aug 10 03:40:39.786824 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 129/252] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:40:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 03:40:39.798809 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1a106102-d6b6-44d5-8db8-fb8784367561 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:39.800506 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1a106102-d6b6-44d5-8db8-fb8784367561 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:39.836305 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Flavor limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:40:39.836774 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Image limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:40:39.837310 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Flavor pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:40:39.837792 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Image pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:40:39.838288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:40:39.847889 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:39.848454 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:39.849397 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:39.849892 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:39.855706 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1a106102-d6b6-44d5-8db8-fb8784367561 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:39.865884 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1a106102-d6b6-44d5-8db8-fb8784367561 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1217 microversion: 2.1 time: 0.073241 Aug 10 03:40:39.866924 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 130/253] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:39 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:39.872955 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Getting quotas for project 46fb8b2b63114fd68f07ec997a49a162. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:40:39.877013 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Getting quotas for user 84491dcbe2d1410a8d7557538c91c204 and project 46fb8b2b63114fd68f07ec997a49a162. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:40:39.887947 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Going to run 1 instances... {{(pid=108439) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:40:39.890343 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:40:40.042962 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e8bc8a45-d1da-4e1f-99e1-aa7c2151ab26 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:40.044570 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e8bc8a45-d1da-4e1f-99e1-aa7c2151ab26 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:40.049287 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-04b5b57e-d83d-4060-bdc3-0ff3b9998993 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625915 Aug 10 03:40:40.050221 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 124/254] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:40:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 03:40:40.051846 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e8bc8a45-d1da-4e1f-99e1-aa7c2151ab26 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:40.052471 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e8bc8a45-d1da-4e1f-99e1-aa7c2151ab26 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:40.053419 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e8bc8a45-d1da-4e1f-99e1-aa7c2151ab26 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:40.054005 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e8bc8a45-d1da-4e1f-99e1-aa7c2151ab26 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:40.059889 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e21c26e0-66f4-4554-9d29-b327e4983009 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:40.060532 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e21c26e0-66f4-4554-9d29-b327e4983009 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:40.134670 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e21c26e0-66f4-4554-9d29-b327e4983009 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:40.141424 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e21c26e0-66f4-4554-9d29-b327e4983009 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1213 microversion: 2.1 time: 0.085247 Aug 10 03:40:40.142367 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 125/255] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:40 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:40.157994 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-45e1e1d5-5a03-4dbf-9513-4d4cd53cf5e5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:40.157994 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-45e1e1d5-5a03-4dbf-9513-4d4cd53cf5e5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:40.163640 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-45e1e1d5-5a03-4dbf-9513-4d4cd53cf5e5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:40.164081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-45e1e1d5-5a03-4dbf-9513-4d4cd53cf5e5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:40.164964 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-45e1e1d5-5a03-4dbf-9513-4d4cd53cf5e5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:40.165395 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-45e1e1d5-5a03-4dbf-9513-4d4cd53cf5e5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:40.171105 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e8bc8a45-d1da-4e1f-99e1-aa7c2151ab26 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 24906 microversion: 2.1 time: 0.131689 Aug 10 03:40:40.172623 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 131/256] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:40 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 24906 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:40:40.310896 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-45e1e1d5-5a03-4dbf-9513-4d4cd53cf5e5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 27975 microversion: 2.20 time: 0.158645 Aug 10 03:40:40.315594 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 126/257] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:40 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 27975 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:40:40.336702 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-edaee3a7-daf6-47db-b53c-e032c085f15f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:40.337462 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-edaee3a7-daf6-47db-b53c-e032c085f15f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:40.348438 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-edaee3a7-daf6-47db-b53c-e032c085f15f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:40.348438 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-edaee3a7-daf6-47db-b53c-e032c085f15f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:40.348438 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-edaee3a7-daf6-47db-b53c-e032c085f15f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:40.348438 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-edaee3a7-daf6-47db-b53c-e032c085f15f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:40.479106 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-edaee3a7-daf6-47db-b53c-e032c085f15f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:40.487403 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-edaee3a7-daf6-47db-b53c-e032c085f15f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.154880 Aug 10 03:40:40.488379 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 132/258] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:40 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:40.883365 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-95e5b0a0-36dc-4da8-a0be-8b8086e4b021 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:40.884066 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-95e5b0a0-36dc-4da8-a0be-8b8086e4b021 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:40.935782 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-95e5b0a0-36dc-4da8-a0be-8b8086e4b021 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:40.942418 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-95e5b0a0-36dc-4da8-a0be-8b8086e4b021 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1217 microversion: 2.1 time: 0.063076 Aug 10 03:40:40.942979 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 127/259] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:40 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1217 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:41.159141 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8743e0f0-35d4-4a16-9315-faf41f6de078 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:41.159834 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8743e0f0-35d4-4a16-9315-faf41f6de078 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:41.182753 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-09773639-68ba-4dad-bf2c-5b4c4c8a55db tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:41.183910 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-09773639-68ba-4dad-bf2c-5b4c4c8a55db tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:41.190924 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-09773639-68ba-4dad-bf2c-5b4c4c8a55db tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:41.191390 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-09773639-68ba-4dad-bf2c-5b4c4c8a55db tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:41.192154 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-09773639-68ba-4dad-bf2c-5b4c4c8a55db tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:41.192609 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-09773639-68ba-4dad-bf2c-5b4c4c8a55db tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:41.437158 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-8743e0f0-35d4-4a16-9315-faf41f6de078 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:41.444793 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8743e0f0-35d4-4a16-9315-faf41f6de078 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1213 microversion: 2.1 time: 0.289919 Aug 10 03:40:41.445469 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 133/260] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:41 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1213 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:41.449950 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-189ad939-0c0d-4113-a690-2afda97c11e5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:41.450970 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-189ad939-0c0d-4113-a690-2afda97c11e5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:41.458694 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-189ad939-0c0d-4113-a690-2afda97c11e5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:41.459264 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-189ad939-0c0d-4113-a690-2afda97c11e5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:41.460112 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-189ad939-0c0d-4113-a690-2afda97c11e5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:41.460644 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-189ad939-0c0d-4113-a690-2afda97c11e5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:43.384588 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-09773639-68ba-4dad-bf2c-5b4c4c8a55db tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 27554 microversion: 2.1 time: 2.205277 Aug 10 03:40:43.385478 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 128/261] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:41 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 27554 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:40:43.390306 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-83820519-e8f6-4d2e-aa13-acc214238038 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:43.391506 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-83820519-e8f6-4d2e-aa13-acc214238038 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:43.397881 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-83820519-e8f6-4d2e-aa13-acc214238038 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:43.398321 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-83820519-e8f6-4d2e-aa13-acc214238038 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:43.399116 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-83820519-e8f6-4d2e-aa13-acc214238038 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:43.399726 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-83820519-e8f6-4d2e-aa13-acc214238038 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:43.420951 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-189ad939-0c0d-4113-a690-2afda97c11e5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 28163 microversion: 2.20 time: 1.974068 Aug 10 03:40:43.425326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 134/262] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:41 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 28163 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:40:43.426846 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4aa85e15-fea5-4aae-9a71-affba266fd45 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:43.427581 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4aa85e15-fea5-4aae-9a71-affba266fd45 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:43.434384 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4aa85e15-fea5-4aae-9a71-affba266fd45 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:43.434908 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4aa85e15-fea5-4aae-9a71-affba266fd45 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:43.435777 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4aa85e15-fea5-4aae-9a71-affba266fd45 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:43.436228 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4aa85e15-fea5-4aae-9a71-affba266fd45 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:43.539509 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-83820519-e8f6-4d2e-aa13-acc214238038 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:43.549989 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-4aa85e15-fea5-4aae-9a71-affba266fd45 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:43.564566 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4aa85e15-fea5-4aae-9a71-affba266fd45 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1221 microversion: 2.1 time: 0.141368 Aug 10 03:40:43.566169 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-83820519-e8f6-4d2e-aa13-acc214238038 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.179406 Aug 10 03:40:43.566854 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 129/263] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:43 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:43.567546 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 135/264] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:43 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:43.580832 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-60cc3494-c129-440c-b378-9b26b190c279 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:43.581770 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-60cc3494-c129-440c-b378-9b26b190c279 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:43.589628 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-60cc3494-c129-440c-b378-9b26b190c279 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:43.590616 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-60cc3494-c129-440c-b378-9b26b190c279 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:43.591716 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-60cc3494-c129-440c-b378-9b26b190c279 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:43.592578 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-60cc3494-c129-440c-b378-9b26b190c279 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:43.664403 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-60cc3494-c129-440c-b378-9b26b190c279 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:43.671978 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-60cc3494-c129-440c-b378-9b26b190c279 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1217 microversion: 2.1 time: 0.103245 Aug 10 03:40:43.672832 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 130/265] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:43 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:44.395854 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-07d6bc3e-4b3e-4c6e-a5ae-4d3b55baf0fb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:44.396817 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-07d6bc3e-4b3e-4c6e-a5ae-4d3b55baf0fb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:44.402992 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-07d6bc3e-4b3e-4c6e-a5ae-4d3b55baf0fb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:44.403439 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-07d6bc3e-4b3e-4c6e-a5ae-4d3b55baf0fb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:44.410025 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-07d6bc3e-4b3e-4c6e-a5ae-4d3b55baf0fb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:44.410025 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-07d6bc3e-4b3e-4c6e-a5ae-4d3b55baf0fb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:44.433266 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e3692a2e-257d-4238-8d6b-478e07d2c8fd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:44.434262 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e3692a2e-257d-4238-8d6b-478e07d2c8fd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:44.441223 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3692a2e-257d-4238-8d6b-478e07d2c8fd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:44.441659 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3692a2e-257d-4238-8d6b-478e07d2c8fd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:44.442434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3692a2e-257d-4238-8d6b-478e07d2c8fd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:44.442864 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3692a2e-257d-4238-8d6b-478e07d2c8fd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:44.549941 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-07d6bc3e-4b3e-4c6e-a5ae-4d3b55baf0fb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 27777 microversion: 2.1 time: 0.157577 Aug 10 03:40:44.553944 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 136/266] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:44 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 27777 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:40:44.583308 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0bd0b74c-1735-42cf-8c8e-960c4968e719 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:44.584307 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0bd0b74c-1735-42cf-8c8e-960c4968e719 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:44.590796 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0bd0b74c-1735-42cf-8c8e-960c4968e719 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:44.591236 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0bd0b74c-1735-42cf-8c8e-960c4968e719 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:44.592002 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0bd0b74c-1735-42cf-8c8e-960c4968e719 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:44.592459 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0bd0b74c-1735-42cf-8c8e-960c4968e719 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:44.602501 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e3692a2e-257d-4238-8d6b-478e07d2c8fd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 28163 microversion: 2.20 time: 0.172784 Aug 10 03:40:44.604416 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 131/267] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:44 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 28163 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:40:44.610513 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d3f28206-7926-4e03-9a37-8d9b63c084e6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:44.611592 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d3f28206-7926-4e03-9a37-8d9b63c084e6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:44.618502 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d3f28206-7926-4e03-9a37-8d9b63c084e6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:44.619204 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d3f28206-7926-4e03-9a37-8d9b63c084e6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:44.620217 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d3f28206-7926-4e03-9a37-8d9b63c084e6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:44.621068 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d3f28206-7926-4e03-9a37-8d9b63c084e6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:44.737634 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d3f28206-7926-4e03-9a37-8d9b63c084e6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:44.751109 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0bd0b74c-1735-42cf-8c8e-960c4968e719 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:44.752942 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d3f28206-7926-4e03-9a37-8d9b63c084e6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1269 microversion: 2.1 time: 0.146731 Aug 10 03:40:44.760147 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0bd0b74c-1735-42cf-8c8e-960c4968e719 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.179390 Aug 10 03:40:44.763589 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 132/268] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:44 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:44.768255 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 137/269] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:44 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:44.769164 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f06c9f88-e096-4620-8c38-ee3de56aa0f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:44.769799 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f06c9f88-e096-4620-8c38-ee3de56aa0f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:44.775692 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f06c9f88-e096-4620-8c38-ee3de56aa0f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:44.776129 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f06c9f88-e096-4620-8c38-ee3de56aa0f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:44.777082 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f06c9f88-e096-4620-8c38-ee3de56aa0f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:44.777569 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f06c9f88-e096-4620-8c38-ee3de56aa0f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:44.847886 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f06c9f88-e096-4620-8c38-ee3de56aa0f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:44.855203 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f06c9f88-e096-4620-8c38-ee3de56aa0f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1209 microversion: 2.1 time: 0.090169 Aug 10 03:40:44.855769 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 133/270] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:44 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:45.561552 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-cdef08a2-8bd4-4063-ac6a-cc5d5dfe2f7d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:45.562342 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-cdef08a2-8bd4-4063-ac6a-cc5d5dfe2f7d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:45.568682 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cdef08a2-8bd4-4063-ac6a-cc5d5dfe2f7d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:45.569130 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cdef08a2-8bd4-4063-ac6a-cc5d5dfe2f7d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:45.569907 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cdef08a2-8bd4-4063-ac6a-cc5d5dfe2f7d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:45.570495 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cdef08a2-8bd4-4063-ac6a-cc5d5dfe2f7d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:45.625657 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2bb0ddd2-9c1c-4804-b407-0c5f117c651f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:45.625657 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2bb0ddd2-9c1c-4804-b407-0c5f117c651f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:45.628525 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2bb0ddd2-9c1c-4804-b407-0c5f117c651f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:45.628973 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2bb0ddd2-9c1c-4804-b407-0c5f117c651f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:45.630321 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2bb0ddd2-9c1c-4804-b407-0c5f117c651f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:45.631037 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2bb0ddd2-9c1c-4804-b407-0c5f117c651f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:45.678390 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-cdef08a2-8bd4-4063-ac6a-cc5d5dfe2f7d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 28199 microversion: 2.1 time: 0.120596 Aug 10 03:40:45.679330 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 138/271] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:45 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 28199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:40:45.772356 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2bb0ddd2-9c1c-4804-b407-0c5f117c651f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 28163 microversion: 2.20 time: 0.156506 Aug 10 03:40:45.772757 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3750b514-db92-411e-afe5-b922ed989b05 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:45.776671 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 134/272] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:45 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 28163 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:40:45.778794 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3750b514-db92-411e-afe5-b922ed989b05 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:45.785219 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-14d484be-af72-489c-b9df-4618775be54b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:45.786065 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-14d484be-af72-489c-b9df-4618775be54b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:45.786991 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3750b514-db92-411e-afe5-b922ed989b05 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:45.787625 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3750b514-db92-411e-afe5-b922ed989b05 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:45.789190 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3750b514-db92-411e-afe5-b922ed989b05 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:45.789671 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3750b514-db92-411e-afe5-b922ed989b05 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:45.795514 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-14d484be-af72-489c-b9df-4618775be54b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:45.795972 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-14d484be-af72-489c-b9df-4618775be54b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:45.797411 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-14d484be-af72-489c-b9df-4618775be54b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:45.797909 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-14d484be-af72-489c-b9df-4618775be54b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:45.877306 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3750b514-db92-411e-afe5-b922ed989b05 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:45.885926 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3750b514-db92-411e-afe5-b922ed989b05 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1275 microversion: 2.1 time: 0.118012 Aug 10 03:40:45.886378 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 139/273] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:45 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:45.891488 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7566729d-37d0-4248-8c76-74265a2afb5c tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:45.892284 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7566729d-37d0-4248-8c76-74265a2afb5c tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:45.898407 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7566729d-37d0-4248-8c76-74265a2afb5c tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:45.898845 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7566729d-37d0-4248-8c76-74265a2afb5c tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:45.899614 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7566729d-37d0-4248-8c76-74265a2afb5c tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:45.900057 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7566729d-37d0-4248-8c76-74265a2afb5c tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:45.947985 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-14d484be-af72-489c-b9df-4618775be54b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:45.955898 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-14d484be-af72-489c-b9df-4618775be54b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.180607 Aug 10 03:40:45.956497 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 135/274] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:45 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:45.982625 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7566729d-37d0-4248-8c76-74265a2afb5c tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:45.992533 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7566729d-37d0-4248-8c76-74265a2afb5c tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1265 microversion: 2.1 time: 0.104910 Aug 10 03:40:45.993179 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 140/275] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:45 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:46.706184 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f32e12f6-fff3-435d-bfec-0ffb5f4c53ba tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:46.706184 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f32e12f6-fff3-435d-bfec-0ffb5f4c53ba tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:46.720942 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f32e12f6-fff3-435d-bfec-0ffb5f4c53ba tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:46.722204 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f32e12f6-fff3-435d-bfec-0ffb5f4c53ba tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:46.723990 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f32e12f6-fff3-435d-bfec-0ffb5f4c53ba tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:46.725017 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f32e12f6-fff3-435d-bfec-0ffb5f4c53ba tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:46.789552 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c7dae397-5af6-472c-b9bf-8da78aacc5d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:46.791036 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c7dae397-5af6-472c-b9bf-8da78aacc5d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:46.813908 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c7dae397-5af6-472c-b9bf-8da78aacc5d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:46.814968 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c7dae397-5af6-472c-b9bf-8da78aacc5d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:46.816452 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c7dae397-5af6-472c-b9bf-8da78aacc5d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:46.817321 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c7dae397-5af6-472c-b9bf-8da78aacc5d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:46.905274 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f32e12f6-fff3-435d-bfec-0ffb5f4c53ba tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 28199 microversion: 2.1 time: 0.215245 Aug 10 03:40:46.905807 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 136/276] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:46 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 28199 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:40:46.913747 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ddeb2dfa-f00c-4ce5-9984-29acc29f7b49 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:46.914443 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ddeb2dfa-f00c-4ce5-9984-29acc29f7b49 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:46.921026 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ddeb2dfa-f00c-4ce5-9984-29acc29f7b49 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:46.921468 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ddeb2dfa-f00c-4ce5-9984-29acc29f7b49 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:46.922818 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ddeb2dfa-f00c-4ce5-9984-29acc29f7b49 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:46.923241 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ddeb2dfa-f00c-4ce5-9984-29acc29f7b49 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:46.972671 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c7dae397-5af6-472c-b9bf-8da78aacc5d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 28454 microversion: 2.20 time: 0.189960 Aug 10 03:40:46.973309 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 141/277] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:46 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 28454 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:40:46.978464 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4b69e4bd-b66f-410c-b59b-33a2eee80975 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:46.979158 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4b69e4bd-b66f-410c-b59b-33a2eee80975 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:46.986701 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4b69e4bd-b66f-410c-b59b-33a2eee80975 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:46.991766 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4b69e4bd-b66f-410c-b59b-33a2eee80975 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:46.991766 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4b69e4bd-b66f-410c-b59b-33a2eee80975 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:46.991766 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4b69e4bd-b66f-410c-b59b-33a2eee80975 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:47.062173 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ddeb2dfa-f00c-4ce5-9984-29acc29f7b49 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:47.071642 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ddeb2dfa-f00c-4ce5-9984-29acc29f7b49 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1317 microversion: 2.1 time: 0.163940 Aug 10 03:40:47.072676 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 137/278] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:46 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:47.077089 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-44a775a7-58d5-45be-b499-b33ec807ad3f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:47.077689 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-44a775a7-58d5-45be-b499-b33ec807ad3f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:47.083669 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-44a775a7-58d5-45be-b499-b33ec807ad3f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:47.084360 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-44a775a7-58d5-45be-b499-b33ec807ad3f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:47.085407 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-44a775a7-58d5-45be-b499-b33ec807ad3f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:47.085988 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-44a775a7-58d5-45be-b499-b33ec807ad3f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:47.159661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-44a775a7-58d5-45be-b499-b33ec807ad3f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:47.168000 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-44a775a7-58d5-45be-b499-b33ec807ad3f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1271 microversion: 2.1 time: 0.094299 Aug 10 03:40:47.168612 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 138/279] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:47 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:47.318693 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-4b69e4bd-b66f-410c-b59b-33a2eee80975 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:47.327192 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4b69e4bd-b66f-410c-b59b-33a2eee80975 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.352560 Aug 10 03:40:47.327892 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 142/280] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:46 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:47.648472 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-e292e914-27a2-4e18-b6b5-91fc3fb522d8 req-390a50b0-08d9-4482-9c06-a5e008f051a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f338fd01-6509-4b6f-815f-b6686013e38f", "tag": "5766f816-81bb-4e8a-b365-c9a5595643b6"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:47.648472 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:40:47.648472 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:40:47.651433 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-e292e914-27a2-4e18-b6b5-91fc3fb522d8 req-390a50b0-08d9-4482-9c06-a5e008f051a4 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:47.652043 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-e292e914-27a2-4e18-b6b5-91fc3fb522d8 req-390a50b0-08d9-4482-9c06-a5e008f051a4 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:47.663499 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-e292e914-27a2-4e18-b6b5-91fc3fb522d8 req-390a50b0-08d9-4482-9c06-a5e008f051a4 service nova] Creating event network-changed:5766f816-81bb-4e8a-b365-c9a5595643b6 for instance f338fd01-6509-4b6f-815f-b6686013e38f on hv-cinder-78239 Aug 10 03:40:47.669171 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-e292e914-27a2-4e18-b6b5-91fc3fb522d8 req-390a50b0-08d9-4482-9c06-a5e008f051a4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031332 Aug 10 03:40:47.670252 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 139/281] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:40:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:40:47.918020 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ba5c6453-4e78-486a-9e48-95aa67c66f2b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:47.919116 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ba5c6453-4e78-486a-9e48-95aa67c66f2b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:47.925433 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ba5c6453-4e78-486a-9e48-95aa67c66f2b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:47.926775 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ba5c6453-4e78-486a-9e48-95aa67c66f2b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:47.927598 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ba5c6453-4e78-486a-9e48-95aa67c66f2b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:47.928213 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ba5c6453-4e78-486a-9e48-95aa67c66f2b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:47.986206 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-fbb05a56-f7cf-4ef1-b8d7-e261c9ff1089 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:47.987127 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-fbb05a56-f7cf-4ef1-b8d7-e261c9ff1089 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:47.997274 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbb05a56-f7cf-4ef1-b8d7-e261c9ff1089 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:47.998232 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbb05a56-f7cf-4ef1-b8d7-e261c9ff1089 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:47.999322 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbb05a56-f7cf-4ef1-b8d7-e261c9ff1089 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:47.999792 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbb05a56-f7cf-4ef1-b8d7-e261c9ff1089 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:48.042795 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ba5c6453-4e78-486a-9e48-95aa67c66f2b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 28490 microversion: 2.1 time: 0.128557 Aug 10 03:40:48.044489 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 143/282] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:47 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 28490 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:40:48.088651 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e1406d00-be82-4b3f-92ea-72f2d5cff581 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:48.089594 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e1406d00-be82-4b3f-92ea-72f2d5cff581 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:48.097668 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e1406d00-be82-4b3f-92ea-72f2d5cff581 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:48.098115 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e1406d00-be82-4b3f-92ea-72f2d5cff581 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:48.098890 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e1406d00-be82-4b3f-92ea-72f2d5cff581 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:48.099377 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e1406d00-be82-4b3f-92ea-72f2d5cff581 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:48.121418 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-fbb05a56-f7cf-4ef1-b8d7-e261c9ff1089 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 28621 microversion: 2.20 time: 0.140054 Aug 10 03:40:48.122587 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 140/283] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:47 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 28621 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:40:48.185515 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2f6b4888-a9e0-4ecc-bf14-454d7a8b4dd9 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:48.186702 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2f6b4888-a9e0-4ecc-bf14-454d7a8b4dd9 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:48.194645 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2f6b4888-a9e0-4ecc-bf14-454d7a8b4dd9 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:48.195370 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2f6b4888-a9e0-4ecc-bf14-454d7a8b4dd9 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:48.196136 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2f6b4888-a9e0-4ecc-bf14-454d7a8b4dd9 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:48.196591 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2f6b4888-a9e0-4ecc-bf14-454d7a8b4dd9 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:48.313835 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e1406d00-be82-4b3f-92ea-72f2d5cff581 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:48.322421 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e1406d00-be82-4b3f-92ea-72f2d5cff581 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1317 microversion: 2.1 time: 0.238103 Aug 10 03:40:48.323171 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 144/284] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:48 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:48.331726 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2f6b4888-a9e0-4ecc-bf14-454d7a8b4dd9 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:48.339207 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2f6b4888-a9e0-4ecc-bf14-454d7a8b4dd9 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1313 microversion: 2.1 time: 0.157769 Aug 10 03:40:48.340019 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 141/285] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:48 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:48.344609 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-20adf235-35a4-465a-a8ce-9cf0737d5b35 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:48.345290 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-20adf235-35a4-465a-a8ce-9cf0737d5b35 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:48.351472 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-20adf235-35a4-465a-a8ce-9cf0737d5b35 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:48.351906 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-20adf235-35a4-465a-a8ce-9cf0737d5b35 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:48.352707 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-20adf235-35a4-465a-a8ce-9cf0737d5b35 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:48.353206 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-20adf235-35a4-465a-a8ce-9cf0737d5b35 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:48.552143 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-20adf235-35a4-465a-a8ce-9cf0737d5b35 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:48.560374 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-20adf235-35a4-465a-a8ce-9cf0737d5b35 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.219399 Aug 10 03:40:48.561157 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 145/286] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:48 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:49.055672 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9a4971ec-9db0-4dfe-9f2a-13a90d391b09 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:49.057350 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9a4971ec-9db0-4dfe-9f2a-13a90d391b09 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:49.074771 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9a4971ec-9db0-4dfe-9f2a-13a90d391b09 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:49.075228 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9a4971ec-9db0-4dfe-9f2a-13a90d391b09 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:49.076032 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9a4971ec-9db0-4dfe-9f2a-13a90d391b09 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:49.078123 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9a4971ec-9db0-4dfe-9f2a-13a90d391b09 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:49.133760 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c90f4a79-e3c5-4678-a82a-a28c41c5ecb5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:49.134658 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c90f4a79-e3c5-4678-a82a-a28c41c5ecb5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:49.142605 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c90f4a79-e3c5-4678-a82a-a28c41c5ecb5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:49.143093 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c90f4a79-e3c5-4678-a82a-a28c41c5ecb5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:49.143866 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c90f4a79-e3c5-4678-a82a-a28c41c5ecb5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:49.149295 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c90f4a79-e3c5-4678-a82a-a28c41c5ecb5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:49.260044 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9a4971ec-9db0-4dfe-9f2a-13a90d391b09 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 28490 microversion: 2.1 time: 0.208101 Aug 10 03:40:49.260715 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 142/287] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:49 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 28490 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:40:49.298272 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c90f4a79-e3c5-4678-a82a-a28c41c5ecb5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 28621 microversion: 2.20 time: 0.167883 Aug 10 03:40:49.299785 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 146/288] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:49 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 28621 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:40:49.342923 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3966be28-ec17-4846-b74b-21d29dbfc74c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:49.346741 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3966be28-ec17-4846-b74b-21d29dbfc74c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:49.356714 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8eba5a4e-ba21-4ebd-a926-777b085227b4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:49.357414 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8eba5a4e-ba21-4ebd-a926-777b085227b4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:49.372550 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8eba5a4e-ba21-4ebd-a926-777b085227b4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:49.372932 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8eba5a4e-ba21-4ebd-a926-777b085227b4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:49.373725 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8eba5a4e-ba21-4ebd-a926-777b085227b4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:49.374233 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8eba5a4e-ba21-4ebd-a926-777b085227b4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:49.377408 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3966be28-ec17-4846-b74b-21d29dbfc74c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:49.378119 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3966be28-ec17-4846-b74b-21d29dbfc74c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:49.378915 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3966be28-ec17-4846-b74b-21d29dbfc74c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:49.379350 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3966be28-ec17-4846-b74b-21d29dbfc74c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:49.571853 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3966be28-ec17-4846-b74b-21d29dbfc74c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:49.579756 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3966be28-ec17-4846-b74b-21d29dbfc74c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1317 microversion: 2.1 time: 0.243305 Aug 10 03:40:49.580762 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 143/289] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:49 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:49.585356 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f8316daa-aa1a-487c-b90e-80f6766496df tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:49.586526 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f8316daa-aa1a-487c-b90e-80f6766496df tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:49.593619 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8316daa-aa1a-487c-b90e-80f6766496df tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:49.594160 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8316daa-aa1a-487c-b90e-80f6766496df tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:49.595466 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8316daa-aa1a-487c-b90e-80f6766496df tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:49.596480 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8316daa-aa1a-487c-b90e-80f6766496df tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:49.596601 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-8eba5a4e-ba21-4ebd-a926-777b085227b4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:49.606917 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8eba5a4e-ba21-4ebd-a926-777b085227b4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1313 microversion: 2.1 time: 0.254272 Aug 10 03:40:49.610947 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 147/290] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:49 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:49.736672 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f8316daa-aa1a-487c-b90e-80f6766496df tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:49.743853 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-15a3a38a-55fb-4944-a8c8-951cda282687 req-e4fbc060-02ac-482f-9304-9264020a5fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8075af1-76b3-46a2-809d-87d7cb03d811", "tag": "4e279ed4-c72e-4d9c-a351-411e196088fc"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:49.745716 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:40:49.745716 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:40:49.746272 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f8316daa-aa1a-487c-b90e-80f6766496df tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.164307 Aug 10 03:40:49.747622 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 144/291] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:49 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:49.754904 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-15a3a38a-55fb-4944-a8c8-951cda282687 req-e4fbc060-02ac-482f-9304-9264020a5fd7 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:49.755561 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-15a3a38a-55fb-4944-a8c8-951cda282687 req-e4fbc060-02ac-482f-9304-9264020a5fd7 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:49.779361 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-15a3a38a-55fb-4944-a8c8-951cda282687 req-e4fbc060-02ac-482f-9304-9264020a5fd7 service nova] Creating event network-changed:4e279ed4-c72e-4d9c-a351-411e196088fc for instance e8075af1-76b3-46a2-809d-87d7cb03d811 on hv-cinder-78239 Aug 10 03:40:49.779361 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-15a3a38a-55fb-4944-a8c8-951cda282687 req-e4fbc060-02ac-482f-9304-9264020a5fd7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037510 Aug 10 03:40:49.779361 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 148/292] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:40:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:40:50.272835 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-af29a4f7-6b16-4b60-bca2-beb6805131f6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:50.273749 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-af29a4f7-6b16-4b60-bca2-beb6805131f6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:50.280502 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-af29a4f7-6b16-4b60-bca2-beb6805131f6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:50.281060 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-af29a4f7-6b16-4b60-bca2-beb6805131f6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:50.282429 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-af29a4f7-6b16-4b60-bca2-beb6805131f6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:50.282929 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-af29a4f7-6b16-4b60-bca2-beb6805131f6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:50.311314 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-25698b91-5d63-4cf1-9e08-30c060f28320 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:50.312398 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-25698b91-5d63-4cf1-9e08-30c060f28320 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:50.318816 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-25698b91-5d63-4cf1-9e08-30c060f28320 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:50.319257 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-25698b91-5d63-4cf1-9e08-30c060f28320 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:50.320048 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-25698b91-5d63-4cf1-9e08-30c060f28320 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:50.320528 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-25698b91-5d63-4cf1-9e08-30c060f28320 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:50.858553 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-af29a4f7-6b16-4b60-bca2-beb6805131f6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 28657 microversion: 2.1 time: 0.589474 Aug 10 03:40:50.860091 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 145/293] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:50 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 28657 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:40:50.864912 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-10f30ddb-4294-41bc-ab97-3c0704a9216c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:50.865601 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-10f30ddb-4294-41bc-ab97-3c0704a9216c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:50.871965 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-10f30ddb-4294-41bc-ab97-3c0704a9216c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:50.872452 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-10f30ddb-4294-41bc-ab97-3c0704a9216c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:50.875869 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-10f30ddb-4294-41bc-ab97-3c0704a9216c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:50.875869 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-10f30ddb-4294-41bc-ab97-3c0704a9216c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:50.879748 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-25698b91-5d63-4cf1-9e08-30c060f28320 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 28621 microversion: 2.20 time: 0.572290 Aug 10 03:40:50.880651 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 149/294] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:50 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 28621 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:40:50.886315 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1a0aa358-80bf-47f6-92b5-c7fb148f52cc tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:50.887099 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1a0aa358-80bf-47f6-92b5-c7fb148f52cc tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:50.894014 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1a0aa358-80bf-47f6-92b5-c7fb148f52cc tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:50.894543 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1a0aa358-80bf-47f6-92b5-c7fb148f52cc tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:50.895317 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1a0aa358-80bf-47f6-92b5-c7fb148f52cc tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:50.895769 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1a0aa358-80bf-47f6-92b5-c7fb148f52cc tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:51.031725 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-10f30ddb-4294-41bc-ab97-3c0704a9216c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:51.039394 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-10f30ddb-4294-41bc-ab97-3c0704a9216c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1317 microversion: 2.1 time: 0.178463 Aug 10 03:40:51.039910 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 146/295] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:50 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:51.053963 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-078165cb-2def-4d84-b7c4-1ee900ff9aa2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:51.054785 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-078165cb-2def-4d84-b7c4-1ee900ff9aa2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:51.070689 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-078165cb-2def-4d84-b7c4-1ee900ff9aa2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:51.070689 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-078165cb-2def-4d84-b7c4-1ee900ff9aa2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:51.070689 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-078165cb-2def-4d84-b7c4-1ee900ff9aa2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:51.070689 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-078165cb-2def-4d84-b7c4-1ee900ff9aa2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:51.146176 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1a0aa358-80bf-47f6-92b5-c7fb148f52cc tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:51.154331 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1a0aa358-80bf-47f6-92b5-c7fb148f52cc tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1313 microversion: 2.1 time: 0.272127 Aug 10 03:40:51.165382 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 150/296] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:50 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:51.225920 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-078165cb-2def-4d84-b7c4-1ee900ff9aa2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:51.235152 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-078165cb-2def-4d84-b7c4-1ee900ff9aa2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.193956 Aug 10 03:40:51.235999 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 147/297] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:51 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:51.873386 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-9e83d3ed-a0e7-4f04-9909-7448bcd54236 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:51.875607 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-9e83d3ed-a0e7-4f04-9909-7448bcd54236 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:51.882104 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9e83d3ed-a0e7-4f04-9909-7448bcd54236 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:51.882762 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9e83d3ed-a0e7-4f04-9909-7448bcd54236 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:51.883693 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9e83d3ed-a0e7-4f04-9909-7448bcd54236 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:51.884111 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9e83d3ed-a0e7-4f04-9909-7448bcd54236 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:51.892554 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-197f6b31-fee9-4924-b9c0-e5874c0eb1d4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:51.894114 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-197f6b31-fee9-4924-b9c0-e5874c0eb1d4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:51.902303 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-197f6b31-fee9-4924-b9c0-e5874c0eb1d4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:51.903229 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-197f6b31-fee9-4924-b9c0-e5874c0eb1d4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:51.904264 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-197f6b31-fee9-4924-b9c0-e5874c0eb1d4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:51.905100 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-197f6b31-fee9-4924-b9c0-e5874c0eb1d4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:52.052843 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-9e83d3ed-a0e7-4f04-9909-7448bcd54236 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 28657 microversion: 2.1 time: 0.185249 Aug 10 03:40:52.057264 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 151/298] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:51 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 28657 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:40:52.058492 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-215a6a91-bb6f-4d8d-b670-2995e613da12 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:52.059182 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-215a6a91-bb6f-4d8d-b670-2995e613da12 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:52.066569 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-215a6a91-bb6f-4d8d-b670-2995e613da12 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:52.067228 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-215a6a91-bb6f-4d8d-b670-2995e613da12 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:52.068230 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-215a6a91-bb6f-4d8d-b670-2995e613da12 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:52.068677 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-215a6a91-bb6f-4d8d-b670-2995e613da12 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:52.201661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-197f6b31-fee9-4924-b9c0-e5874c0eb1d4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 28621 microversion: 2.20 time: 0.305390 Aug 10 03:40:52.201661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 148/299] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:51 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 28621 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:40:52.201661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-fb830ce4-d3ab-4bff-a25f-d72220ca1f1d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:52.201661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-fb830ce4-d3ab-4bff-a25f-d72220ca1f1d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:52.207710 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fb830ce4-d3ab-4bff-a25f-d72220ca1f1d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:52.208139 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fb830ce4-d3ab-4bff-a25f-d72220ca1f1d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:52.209091 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fb830ce4-d3ab-4bff-a25f-d72220ca1f1d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:52.209513 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fb830ce4-d3ab-4bff-a25f-d72220ca1f1d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:52.211241 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-215a6a91-bb6f-4d8d-b670-2995e613da12 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:52.221576 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-215a6a91-bb6f-4d8d-b670-2995e613da12 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1317 microversion: 2.1 time: 0.163762 Aug 10 03:40:52.221576 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 152/300] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:52 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:52.259779 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c9198231-9271-4f95-b461-ce8ee84c2fc2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:52.260547 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c9198231-9271-4f95-b461-ce8ee84c2fc2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:52.266930 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c9198231-9271-4f95-b461-ce8ee84c2fc2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:52.267447 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c9198231-9271-4f95-b461-ce8ee84c2fc2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:52.268330 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c9198231-9271-4f95-b461-ce8ee84c2fc2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:52.268837 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c9198231-9271-4f95-b461-ce8ee84c2fc2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:52.350626 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-fb830ce4-d3ab-4bff-a25f-d72220ca1f1d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:52.358342 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-fb830ce4-d3ab-4bff-a25f-d72220ca1f1d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1313 microversion: 2.1 time: 0.162795 Aug 10 03:40:52.359510 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 149/301] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:52 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:52.400982 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c9198231-9271-4f95-b461-ce8ee84c2fc2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:52.408518 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c9198231-9271-4f95-b461-ce8ee84c2fc2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1523 microversion: 2.1 time: 0.152433 Aug 10 03:40:52.409064 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 153/302] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:52 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:53.065204 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-face503e-562c-4b27-881d-ac4d90ed7cb1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:53.066404 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-face503e-562c-4b27-881d-ac4d90ed7cb1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:53.073286 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-face503e-562c-4b27-881d-ac4d90ed7cb1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:53.073748 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-face503e-562c-4b27-881d-ac4d90ed7cb1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:53.074786 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-face503e-562c-4b27-881d-ac4d90ed7cb1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:53.075266 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-face503e-562c-4b27-881d-ac4d90ed7cb1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:53.204980 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-05511b39-823a-4891-b202-f738b9454af4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:53.205956 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-05511b39-823a-4891-b202-f738b9454af4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:53.209323 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-face503e-562c-4b27-881d-ac4d90ed7cb1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 28657 microversion: 2.1 time: 0.147930 Aug 10 03:40:53.209897 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 150/303] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:53 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 28657 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:40:53.213346 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-05511b39-823a-4891-b202-f738b9454af4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:53.213830 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-05511b39-823a-4891-b202-f738b9454af4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:53.214624 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-05511b39-823a-4891-b202-f738b9454af4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:53.215056 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-05511b39-823a-4891-b202-f738b9454af4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:53.235997 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5e49a86e-e1be-4a8c-ad1b-4188c7dae684 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:53.236749 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-5e49a86e-e1be-4a8c-ad1b-4188c7dae684 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:53.243403 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5e49a86e-e1be-4a8c-ad1b-4188c7dae684 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:53.243845 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5e49a86e-e1be-4a8c-ad1b-4188c7dae684 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:53.244832 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5e49a86e-e1be-4a8c-ad1b-4188c7dae684 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:53.245263 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5e49a86e-e1be-4a8c-ad1b-4188c7dae684 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:53.324932 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-05511b39-823a-4891-b202-f738b9454af4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 28621 microversion: 2.20 time: 0.124520 Aug 10 03:40:53.325612 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 154/304] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:53 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 28621 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:40:53.366093 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-5e49a86e-e1be-4a8c-ad1b-4188c7dae684 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:53.373349 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5e49a86e-e1be-4a8c-ad1b-4188c7dae684 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1317 microversion: 2.1 time: 0.141563 Aug 10 03:40:53.373900 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 151/305] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:53 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:53.375948 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-aab8a834-e8fa-450a-8873-685d32f1d240 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:53.376757 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-aab8a834-e8fa-450a-8873-685d32f1d240 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:53.383319 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aab8a834-e8fa-450a-8873-685d32f1d240 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:53.383756 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aab8a834-e8fa-450a-8873-685d32f1d240 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:53.384536 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aab8a834-e8fa-450a-8873-685d32f1d240 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:53.385014 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aab8a834-e8fa-450a-8873-685d32f1d240 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:53.428350 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5f769d09-2ec5-49cb-9b6f-484c09d416d0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:53.429281 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-5f769d09-2ec5-49cb-9b6f-484c09d416d0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:53.436933 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5f769d09-2ec5-49cb-9b6f-484c09d416d0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:53.437509 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5f769d09-2ec5-49cb-9b6f-484c09d416d0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:53.438288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5f769d09-2ec5-49cb-9b6f-484c09d416d0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:53.438808 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5f769d09-2ec5-49cb-9b6f-484c09d416d0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:53.507194 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-aab8a834-e8fa-450a-8873-685d32f1d240 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:53.514611 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-aab8a834-e8fa-450a-8873-685d32f1d240 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1313 microversion: 2.1 time: 0.142562 Aug 10 03:40:53.515173 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 155/306] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:53 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:53.563735 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-5f769d09-2ec5-49cb-9b6f-484c09d416d0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:53.571222 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5f769d09-2ec5-49cb-9b6f-484c09d416d0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1503 microversion: 2.1 time: 0.148010 Aug 10 03:40:53.571775 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 152/307] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:53 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:53.587151 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-dba92ca2-9186-4e3f-a34d-e7f8e19ff4fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:53.587757 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-dba92ca2-9186-4e3f-a34d-e7f8e19ff4fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:53.593801 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dba92ca2-9186-4e3f-a34d-e7f8e19ff4fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:53.594142 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dba92ca2-9186-4e3f-a34d-e7f8e19ff4fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:53.594904 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dba92ca2-9186-4e3f-a34d-e7f8e19ff4fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:53.595340 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dba92ca2-9186-4e3f-a34d-e7f8e19ff4fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:53.727154 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-dba92ca2-9186-4e3f-a34d-e7f8e19ff4fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:53.734641 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-dba92ca2-9186-4e3f-a34d-e7f8e19ff4fa tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1516 microversion: 2.1 time: 0.151091 Aug 10 03:40:53.735188 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 156/308] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:53 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:53.826351 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1884541420", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:53.884302 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.network.neutron [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] validate_networks() for None {{(pid=108439) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:40:54.222064 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7f7d6694-e890-4153-9d9a-d3d988812ef5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:54.223123 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7f7d6694-e890-4153-9d9a-d3d988812ef5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:54.229907 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7f7d6694-e890-4153-9d9a-d3d988812ef5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:54.230999 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7f7d6694-e890-4153-9d9a-d3d988812ef5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:54.232013 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7f7d6694-e890-4153-9d9a-d3d988812ef5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:54.232468 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7f7d6694-e890-4153-9d9a-d3d988812ef5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:54.354593 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7f7d6694-e890-4153-9d9a-d3d988812ef5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 28657 microversion: 2.1 time: 0.136653 Aug 10 03:40:54.355316 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 157/309] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:54 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 28657 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:40:54.358015 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Flavor limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:40:54.358466 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Image limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:40:54.358899 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Flavor pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:40:54.359908 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Image pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:40:54.360787 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:40:54.362958 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-14793b5f-4d48-46c3-968a-bb28a82d4b93 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:54.364017 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-14793b5f-4d48-46c3-968a-bb28a82d4b93 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:54.370341 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:54.370786 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:54.370998 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-14793b5f-4d48-46c3-968a-bb28a82d4b93 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:54.375697 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-14793b5f-4d48-46c3-968a-bb28a82d4b93 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:54.375773 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:54.375773 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:54.375929 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-14793b5f-4d48-46c3-968a-bb28a82d4b93 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:54.375929 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-14793b5f-4d48-46c3-968a-bb28a82d4b93 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:54.389717 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Getting quotas for project 6f912b62093449cea652d5e2b536ac2a. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:40:54.393524 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Getting quotas for user de20e4d4713d492cbf99cc584bf0446b and project 6f912b62093449cea652d5e2b536ac2a. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:40:54.405698 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Going to run 1 instances... {{(pid=108439) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:40:54.409355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:40:54.511975 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-14793b5f-4d48-46c3-968a-bb28a82d4b93 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 28621 microversion: 2.20 time: 0.155051 Aug 10 03:40:54.519386 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 158/310] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:54 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 28621 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:40:54.526411 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6282a8a6-b2c8-4b94-8235-d60aad982542 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:54.533497 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6282a8a6-b2c8-4b94-8235-d60aad982542 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:54.533497 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6282a8a6-b2c8-4b94-8235-d60aad982542 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:54.533715 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6282a8a6-b2c8-4b94-8235-d60aad982542 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:54.534425 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6282a8a6-b2c8-4b94-8235-d60aad982542 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:54.534853 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6282a8a6-b2c8-4b94-8235-d60aad982542 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:54.574644 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c4631492-954d-468b-8028-120264083f34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751601 Aug 10 03:40:54.575666 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 153/311] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:40:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 03:40:54.580226 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-53c51651-e04c-47f5-91f0-bfbf3bb52917 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:54.580837 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-53c51651-e04c-47f5-91f0-bfbf3bb52917 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:54.597919 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-53c51651-e04c-47f5-91f0-bfbf3bb52917 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:54.597919 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-53c51651-e04c-47f5-91f0-bfbf3bb52917 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:54.597919 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-53c51651-e04c-47f5-91f0-bfbf3bb52917 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:54.597919 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-53c51651-e04c-47f5-91f0-bfbf3bb52917 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:54.704270 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6282a8a6-b2c8-4b94-8235-d60aad982542 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:54.715125 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6282a8a6-b2c8-4b94-8235-d60aad982542 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1317 microversion: 2.1 time: 0.193823 Aug 10 03:40:54.715712 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 159/312] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:54 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:54.720979 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-94d42836-70ee-42eb-afaa-9278e7d7e056 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:54.721597 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-94d42836-70ee-42eb-afaa-9278e7d7e056 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:54.763261 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-53c51651-e04c-47f5-91f0-bfbf3bb52917 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:54.780289 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-53c51651-e04c-47f5-91f0-bfbf3bb52917 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1313 microversion: 2.1 time: 0.194834 Aug 10 03:40:54.780289 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 154/313] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:54 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:54.785681 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-94d42836-70ee-42eb-afaa-9278e7d7e056 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:54.792056 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-94d42836-70ee-42eb-afaa-9278e7d7e056 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1215 microversion: 2.1 time: 0.074971 Aug 10 03:40:54.792637 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 160/314] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:54 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:55.367253 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5690cc34-9e7b-4a2b-8133-990fb1f55188 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:55.368247 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-5690cc34-9e7b-4a2b-8133-990fb1f55188 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:55.374418 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5690cc34-9e7b-4a2b-8133-990fb1f55188 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:55.374907 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5690cc34-9e7b-4a2b-8133-990fb1f55188 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:55.375716 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5690cc34-9e7b-4a2b-8133-990fb1f55188 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:55.376144 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5690cc34-9e7b-4a2b-8133-990fb1f55188 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:55.489392 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5690cc34-9e7b-4a2b-8133-990fb1f55188 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 28657 microversion: 2.1 time: 0.126212 Aug 10 03:40:55.490052 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 155/315] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:55 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 28657 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:40:55.529476 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-cfcc6956-d3a0-4b24-98fc-75918beacfc8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:55.530436 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-cfcc6956-d3a0-4b24-98fc-75918beacfc8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:55.539276 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cfcc6956-d3a0-4b24-98fc-75918beacfc8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:55.542883 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cfcc6956-d3a0-4b24-98fc-75918beacfc8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:55.542883 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cfcc6956-d3a0-4b24-98fc-75918beacfc8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:55.542883 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cfcc6956-d3a0-4b24-98fc-75918beacfc8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:55.598852 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e1904999-bb7b-48e9-8b5d-370cab1e7c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:55.611608 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e1904999-bb7b-48e9-8b5d-370cab1e7c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:55.611608 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e1904999-bb7b-48e9-8b5d-370cab1e7c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:55.611608 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e1904999-bb7b-48e9-8b5d-370cab1e7c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:55.611608 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e1904999-bb7b-48e9-8b5d-370cab1e7c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:55.611927 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e1904999-bb7b-48e9-8b5d-370cab1e7c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:55.630842 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-e1904999-bb7b-48e9-8b5d-370cab1e7c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lazy-loading 'flavor' on Instance uuid f2c37d94-d078-4e35-819d-2ca11fc5cb5f {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:40:55.673149 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-cfcc6956-d3a0-4b24-98fc-75918beacfc8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 28646 microversion: 2.20 time: 0.147165 Aug 10 03:40:55.673787 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 161/316] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:55 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 28646 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:40:55.731961 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-782e43b7-f7eb-4fb1-8390-b13ad09dd859 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:55.732686 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-782e43b7-f7eb-4fb1-8390-b13ad09dd859 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:55.740060 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-782e43b7-f7eb-4fb1-8390-b13ad09dd859 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:55.740534 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-782e43b7-f7eb-4fb1-8390-b13ad09dd859 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:55.741299 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-782e43b7-f7eb-4fb1-8390-b13ad09dd859 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:55.741724 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-782e43b7-f7eb-4fb1-8390-b13ad09dd859 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:55.875640 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-782e43b7-f7eb-4fb1-8390-b13ad09dd859 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:55.883449 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-782e43b7-f7eb-4fb1-8390-b13ad09dd859 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1317 microversion: 2.1 time: 0.155474 Aug 10 03:40:55.884125 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 162/317] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:55 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:55.889050 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f4fa3a3c-632c-4626-9871-e8c597d5523b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:55.889729 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f4fa3a3c-632c-4626-9871-e8c597d5523b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:55.895775 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f4fa3a3c-632c-4626-9871-e8c597d5523b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:55.897506 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f4fa3a3c-632c-4626-9871-e8c597d5523b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:55.898351 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f4fa3a3c-632c-4626-9871-e8c597d5523b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:55.898948 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f4fa3a3c-632c-4626-9871-e8c597d5523b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:56.028589 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f4fa3a3c-632c-4626-9871-e8c597d5523b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:56.036478 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f4fa3a3c-632c-4626-9871-e8c597d5523b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1313 microversion: 2.1 time: 0.151220 Aug 10 03:40:56.037116 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 163/318] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:55 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:56.050631 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e4205436-9b90-46eb-9b71-3ae37de4cf4f tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:56.051227 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e4205436-9b90-46eb-9b71-3ae37de4cf4f tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:56.115005 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e4205436-9b90-46eb-9b71-3ae37de4cf4f tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:56.122228 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e4205436-9b90-46eb-9b71-3ae37de4cf4f tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1215 microversion: 2.1 time: 0.075621 Aug 10 03:40:56.122831 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 164/319] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:56 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:56.211983 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e1904999-bb7b-48e9-8b5d-370cab1e7c7a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "POST /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/action" status: 200 len: 32 microversion: 2.1 time: 0.617836 Aug 10 03:40:56.212874 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 156/320] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:55 2021] POST /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/action => generated 32 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:40:56.222039 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1aa08640-ceb9-403b-9823-b04a2a613b85 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:56.223116 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1aa08640-ceb9-403b-9823-b04a2a613b85 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:56.229591 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1aa08640-ceb9-403b-9823-b04a2a613b85 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:56.230217 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1aa08640-ceb9-403b-9823-b04a2a613b85 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:56.231135 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1aa08640-ceb9-403b-9823-b04a2a613b85 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:56.231773 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1aa08640-ceb9-403b-9823-b04a2a613b85 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:56.289691 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-27d818e4-8c9a-444e-85f8-80671cbf3541 req-04ca72a0-5868-4e67-a4e1-2f5e68b70d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f338fd01-6509-4b6f-815f-b6686013e38f", "name": "network-vif-plugged", "status": "completed", "tag": "5766f816-81bb-4e8a-b365-c9a5595643b6"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:56.292643 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:40:56.292643 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:40:56.302633 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-27d818e4-8c9a-444e-85f8-80671cbf3541 req-04ca72a0-5868-4e67-a4e1-2f5e68b70d32 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:56.303063 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-27d818e4-8c9a-444e-85f8-80671cbf3541 req-04ca72a0-5868-4e67-a4e1-2f5e68b70d32 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:56.314650 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-27d818e4-8c9a-444e-85f8-80671cbf3541 req-04ca72a0-5868-4e67-a4e1-2f5e68b70d32 service nova] Creating event network-vif-plugged:5766f816-81bb-4e8a-b365-c9a5595643b6 for instance f338fd01-6509-4b6f-815f-b6686013e38f on hv-cinder-78239 Aug 10 03:40:56.319583 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-27d818e4-8c9a-444e-85f8-80671cbf3541 req-04ca72a0-5868-4e67-a4e1-2f5e68b70d32 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034218 Aug 10 03:40:56.320784 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 157/321] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:40:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:40:56.367408 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1aa08640-ceb9-403b-9823-b04a2a613b85 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:56.375483 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1aa08640-ceb9-403b-9823-b04a2a613b85 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.157171 Aug 10 03:40:56.376316 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 165/322] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:56 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:56.502883 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9fdea7ad-77e6-422a-9dd3-243a24224e33 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:56.503885 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9fdea7ad-77e6-422a-9dd3-243a24224e33 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:56.510378 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9fdea7ad-77e6-422a-9dd3-243a24224e33 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:56.510857 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9fdea7ad-77e6-422a-9dd3-243a24224e33 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:56.511628 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9fdea7ad-77e6-422a-9dd3-243a24224e33 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:56.512063 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9fdea7ad-77e6-422a-9dd3-243a24224e33 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:56.633179 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9fdea7ad-77e6-422a-9dd3-243a24224e33 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 28657 microversion: 2.1 time: 0.134553 Aug 10 03:40:56.637162 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 158/323] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:56 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 28657 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:40:56.685954 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e7d7e61e-ec15-4828-9cfc-d8e1c15e6b18 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:56.686976 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e7d7e61e-ec15-4828-9cfc-d8e1c15e6b18 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:56.693067 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e7d7e61e-ec15-4828-9cfc-d8e1c15e6b18 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:56.693500 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e7d7e61e-ec15-4828-9cfc-d8e1c15e6b18 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:56.694259 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e7d7e61e-ec15-4828-9cfc-d8e1c15e6b18 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:56.694681 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e7d7e61e-ec15-4828-9cfc-d8e1c15e6b18 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:56.864294 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e7d7e61e-ec15-4828-9cfc-d8e1c15e6b18 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 31566 microversion: 2.20 time: 0.182366 Aug 10 03:40:56.869483 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 166/324] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:56 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 31566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:40:56.901005 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-4c949148-5828-4880-9221-20ab6bb07eac tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:56.902001 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-4c949148-5828-4880-9221-20ab6bb07eac tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:56.909804 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4c949148-5828-4880-9221-20ab6bb07eac tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:56.910598 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4c949148-5828-4880-9221-20ab6bb07eac tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:56.911587 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4c949148-5828-4880-9221-20ab6bb07eac tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:56.912237 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4c949148-5828-4880-9221-20ab6bb07eac tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:57.051507 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4c949148-5828-4880-9221-20ab6bb07eac tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:57.054159 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c4a73691-d861-4b6a-8afb-3f770b5eb7c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:57.058688 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c4a73691-d861-4b6a-8afb-3f770b5eb7c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:57.060548 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-4c949148-5828-4880-9221-20ab6bb07eac tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1317 microversion: 2.1 time: 0.163525 Aug 10 03:40:57.061807 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 159/325] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:56 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:57.064809 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c4a73691-d861-4b6a-8afb-3f770b5eb7c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:57.065249 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c4a73691-d861-4b6a-8afb-3f770b5eb7c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:57.066180 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c4a73691-d861-4b6a-8afb-3f770b5eb7c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:57.066609 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c4a73691-d861-4b6a-8afb-3f770b5eb7c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:57.139175 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c69da8d5-6c0b-40a3-8165-ef52fb6e9a4d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:57.144685 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c69da8d5-6c0b-40a3-8165-ef52fb6e9a4d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:57.146373 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c69da8d5-6c0b-40a3-8165-ef52fb6e9a4d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:57.146918 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c69da8d5-6c0b-40a3-8165-ef52fb6e9a4d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:57.147779 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c69da8d5-6c0b-40a3-8165-ef52fb6e9a4d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:57.148326 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c69da8d5-6c0b-40a3-8165-ef52fb6e9a4d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:57.208926 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c4a73691-d861-4b6a-8afb-3f770b5eb7c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:57.215147 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c69da8d5-6c0b-40a3-8165-ef52fb6e9a4d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:57.216831 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c4a73691-d861-4b6a-8afb-3f770b5eb7c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1313 microversion: 2.1 time: 0.166639 Aug 10 03:40:57.220257 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 167/326] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:57 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:57.222873 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c69da8d5-6c0b-40a3-8165-ef52fb6e9a4d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1211 microversion: 2.1 time: 0.087376 Aug 10 03:40:57.223413 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 160/327] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:57 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:57.393678 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e8e37429-6fe1-43ec-a85d-3d14b49c34b3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:57.394343 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e8e37429-6fe1-43ec-a85d-3d14b49c34b3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:57.400816 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e8e37429-6fe1-43ec-a85d-3d14b49c34b3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:57.401250 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e8e37429-6fe1-43ec-a85d-3d14b49c34b3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:57.401996 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e8e37429-6fe1-43ec-a85d-3d14b49c34b3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:57.402421 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e8e37429-6fe1-43ec-a85d-3d14b49c34b3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:57.538137 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e8e37429-6fe1-43ec-a85d-3d14b49c34b3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:57.545862 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e8e37429-6fe1-43ec-a85d-3d14b49c34b3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.156485 Aug 10 03:40:57.546613 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 168/328] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:57 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:57.645455 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-aa6a00b3-520d-47f2-80a0-04f2073959df tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:57.646406 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-aa6a00b3-520d-47f2-80a0-04f2073959df tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:57.652993 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aa6a00b3-520d-47f2-80a0-04f2073959df tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:57.653439 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aa6a00b3-520d-47f2-80a0-04f2073959df tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:57.654210 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aa6a00b3-520d-47f2-80a0-04f2073959df tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:57.654643 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aa6a00b3-520d-47f2-80a0-04f2073959df tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:57.812641 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-aa6a00b3-520d-47f2-80a0-04f2073959df tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 28657 microversion: 2.1 time: 0.170622 Aug 10 03:40:57.817177 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 161/329] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:57 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 28657 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:40:57.876470 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-79cd0c38-aa12-462e-bdef-29970a8830e3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:57.877377 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-79cd0c38-aa12-462e-bdef-29970a8830e3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:57.883041 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-79cd0c38-aa12-462e-bdef-29970a8830e3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:57.883485 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-79cd0c38-aa12-462e-bdef-29970a8830e3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:57.884272 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-79cd0c38-aa12-462e-bdef-29970a8830e3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:57.884702 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-79cd0c38-aa12-462e-bdef-29970a8830e3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:58.036687 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-79cd0c38-aa12-462e-bdef-29970a8830e3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 32322 microversion: 2.20 time: 0.163697 Aug 10 03:40:58.037526 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 169/330] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:57 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 32322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:40:58.078480 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-022d6906-e943-4ec7-9ea1-e51e3e48606a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:58.079292 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-022d6906-e943-4ec7-9ea1-e51e3e48606a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:58.085791 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-022d6906-e943-4ec7-9ea1-e51e3e48606a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:58.086307 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-022d6906-e943-4ec7-9ea1-e51e3e48606a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:58.087136 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-022d6906-e943-4ec7-9ea1-e51e3e48606a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:58.087633 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-022d6906-e943-4ec7-9ea1-e51e3e48606a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:58.214986 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-022d6906-e943-4ec7-9ea1-e51e3e48606a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:58.228302 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-022d6906-e943-4ec7-9ea1-e51e3e48606a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1317 microversion: 2.1 time: 0.148426 Aug 10 03:40:58.228302 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 162/331] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:58 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:58.234191 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f065ed9f-f0fb-46f6-9668-3c29febaff03 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:58.234910 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f065ed9f-f0fb-46f6-9668-3c29febaff03 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:58.239106 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8ea42e85-c34a-4acb-a750-20eb5990ad89 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:58.239714 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8ea42e85-c34a-4acb-a750-20eb5990ad89 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:58.241571 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f065ed9f-f0fb-46f6-9668-3c29febaff03 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:58.242008 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f065ed9f-f0fb-46f6-9668-3c29febaff03 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:58.242771 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f065ed9f-f0fb-46f6-9668-3c29febaff03 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:58.243195 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f065ed9f-f0fb-46f6-9668-3c29febaff03 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:58.245777 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ea42e85-c34a-4acb-a750-20eb5990ad89 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:58.246226 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ea42e85-c34a-4acb-a750-20eb5990ad89 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:58.246994 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ea42e85-c34a-4acb-a750-20eb5990ad89 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:58.247430 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ea42e85-c34a-4acb-a750-20eb5990ad89 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:58.321678 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8ea42e85-c34a-4acb-a750-20eb5990ad89 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:58.330526 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8ea42e85-c34a-4acb-a750-20eb5990ad89 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1267 microversion: 2.1 time: 0.095097 Aug 10 03:40:58.331355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 163/332] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:58 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:40:58.388918 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f065ed9f-f0fb-46f6-9668-3c29febaff03 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:58.400015 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f065ed9f-f0fb-46f6-9668-3c29febaff03 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1313 microversion: 2.1 time: 0.169798 Aug 10 03:40:58.400620 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 170/333] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:58 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:58.563491 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-31a4d721-b9c0-4863-8a15-8e01ca19620e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:58.564004 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-31a4d721-b9c0-4863-8a15-8e01ca19620e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:58.569890 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-31a4d721-b9c0-4863-8a15-8e01ca19620e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:58.570431 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-31a4d721-b9c0-4863-8a15-8e01ca19620e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:58.571197 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-31a4d721-b9c0-4863-8a15-8e01ca19620e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:58.571632 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-31a4d721-b9c0-4863-8a15-8e01ca19620e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:58.701128 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-31a4d721-b9c0-4863-8a15-8e01ca19620e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:58.708500 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-31a4d721-b9c0-4863-8a15-8e01ca19620e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.149393 Aug 10 03:40:58.709061 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 164/334] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:58 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:58.827848 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3a1b88c9-8501-491b-8bf8-5d393c29fba7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:58.829551 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3a1b88c9-8501-491b-8bf8-5d393c29fba7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:58.836635 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3a1b88c9-8501-491b-8bf8-5d393c29fba7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:58.837083 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3a1b88c9-8501-491b-8bf8-5d393c29fba7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:58.837888 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3a1b88c9-8501-491b-8bf8-5d393c29fba7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:58.838293 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3a1b88c9-8501-491b-8bf8-5d393c29fba7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:59.050291 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3eee35ab-a24b-4432-987c-d960a10721b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:40:59.051459 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3eee35ab-a24b-4432-987c-d960a10721b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:59.057451 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3eee35ab-a24b-4432-987c-d960a10721b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:59.057887 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3eee35ab-a24b-4432-987c-d960a10721b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:59.059301 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3eee35ab-a24b-4432-987c-d960a10721b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:59.059754 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3eee35ab-a24b-4432-987c-d960a10721b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:59.062769 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3a1b88c9-8501-491b-8bf8-5d393c29fba7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 28657 microversion: 2.1 time: 0.239592 Aug 10 03:40:59.063542 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 171/335] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:40:58 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 28657 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:40:59.239323 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-175ec193-3e1d-4d39-b104-86e1de77081f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:59.240076 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-175ec193-3e1d-4d39-b104-86e1de77081f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:59.243078 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3eee35ab-a24b-4432-987c-d960a10721b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 32900 microversion: 2.20 time: 0.194792 Aug 10 03:40:59.248167 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-175ec193-3e1d-4d39-b104-86e1de77081f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:59.249162 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-175ec193-3e1d-4d39-b104-86e1de77081f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:59.250017 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 165/336] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:40:59 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 32900 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:40:59.250226 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-175ec193-3e1d-4d39-b104-86e1de77081f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:59.250895 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-175ec193-3e1d-4d39-b104-86e1de77081f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:59.349798 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-714a238d-7198-4a7f-b8af-60fabb0052bd tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:59.350638 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-714a238d-7198-4a7f-b8af-60fabb0052bd tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:59.358437 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-714a238d-7198-4a7f-b8af-60fabb0052bd tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:59.358437 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-714a238d-7198-4a7f-b8af-60fabb0052bd tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:59.358842 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-714a238d-7198-4a7f-b8af-60fabb0052bd tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:59.359304 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-714a238d-7198-4a7f-b8af-60fabb0052bd tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:59.436134 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-714a238d-7198-4a7f-b8af-60fabb0052bd tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:59.443649 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-714a238d-7198-4a7f-b8af-60fabb0052bd tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1273 microversion: 2.1 time: 0.100054 Aug 10 03:40:59.445111 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 166/337] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:59 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:59.450271 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8424690c-eea5-4e35-91eb-fb0243be220b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:59.450881 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8424690c-eea5-4e35-91eb-fb0243be220b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:59.459185 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8424690c-eea5-4e35-91eb-fb0243be220b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:59.459630 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8424690c-eea5-4e35-91eb-fb0243be220b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:59.460496 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8424690c-eea5-4e35-91eb-fb0243be220b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:59.460937 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8424690c-eea5-4e35-91eb-fb0243be220b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:59.464623 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-175ec193-3e1d-4d39-b104-86e1de77081f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:59.470037 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-175ec193-3e1d-4d39-b104-86e1de77081f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1317 microversion: 2.1 time: 0.235001 Aug 10 03:40:59.470784 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 172/338] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:59 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:59.596407 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8424690c-eea5-4e35-91eb-fb0243be220b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:40:59.603980 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8424690c-eea5-4e35-91eb-fb0243be220b tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1313 microversion: 2.1 time: 0.158019 Aug 10 03:40:59.608234 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 167/339] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:59 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:40:59.725353 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e9f759b4-c10c-4567-a230-5d24b1adc06e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:40:59.725952 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e9f759b4-c10c-4567-a230-5d24b1adc06e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:40:59.731630 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e9f759b4-c10c-4567-a230-5d24b1adc06e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:59.732070 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e9f759b4-c10c-4567-a230-5d24b1adc06e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:40:59.732883 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e9f759b4-c10c-4567-a230-5d24b1adc06e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:40:59.733312 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e9f759b4-c10c-4567-a230-5d24b1adc06e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:00.041308 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e9f759b4-c10c-4567-a230-5d24b1adc06e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:00.048757 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e9f759b4-c10c-4567-a230-5d24b1adc06e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.327069 Aug 10 03:41:00.058116 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 173/340] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:40:59 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:00.080022 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-35a3b131-4bf6-443b-bad3-6be681764383 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:00.087694 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-35a3b131-4bf6-443b-bad3-6be681764383 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:00.095310 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-35a3b131-4bf6-443b-bad3-6be681764383 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:00.095763 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-35a3b131-4bf6-443b-bad3-6be681764383 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:00.096776 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-35a3b131-4bf6-443b-bad3-6be681764383 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:00.097224 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-35a3b131-4bf6-443b-bad3-6be681764383 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:00.193741 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-07ce4dc3-d7a0-47fc-a77d-b537c7c9b83f req-e68bf48a-458b-4234-8aba-274d69db9a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8075af1-76b3-46a2-809d-87d7cb03d811", "name": "network-vif-plugged", "status": "completed", "tag": "4e279ed4-c72e-4d9c-a351-411e196088fc"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:00.195953 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:41:00.195953 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:41:00.203778 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-07ce4dc3-d7a0-47fc-a77d-b537c7c9b83f req-e68bf48a-458b-4234-8aba-274d69db9a25 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:00.204425 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-07ce4dc3-d7a0-47fc-a77d-b537c7c9b83f req-e68bf48a-458b-4234-8aba-274d69db9a25 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:00.229007 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-07ce4dc3-d7a0-47fc-a77d-b537c7c9b83f req-e68bf48a-458b-4234-8aba-274d69db9a25 service nova] Creating event network-vif-plugged:4e279ed4-c72e-4d9c-a351-411e196088fc for instance e8075af1-76b3-46a2-809d-87d7cb03d811 on hv-cinder-78239 Aug 10 03:41:00.235100 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-07ce4dc3-d7a0-47fc-a77d-b537c7c9b83f req-e68bf48a-458b-4234-8aba-274d69db9a25 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044637 Aug 10 03:41:00.236269 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 174/341] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:41:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:41:00.260394 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-84d3b367-8929-4374-9332-295480cad5fc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:00.260394 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-84d3b367-8929-4374-9332-295480cad5fc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:00.269702 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-84d3b367-8929-4374-9332-295480cad5fc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:00.270348 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-84d3b367-8929-4374-9332-295480cad5fc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:00.271283 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-84d3b367-8929-4374-9332-295480cad5fc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:00.271890 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-84d3b367-8929-4374-9332-295480cad5fc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:00.283432 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-35a3b131-4bf6-443b-bad3-6be681764383 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 29342 microversion: 2.1 time: 0.211200 Aug 10 03:41:00.288587 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 168/342] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:00 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 29342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:41:00.426326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-84d3b367-8929-4374-9332-295480cad5fc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 33678 microversion: 2.20 time: 0.174531 Aug 10 03:41:00.426954 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 175/343] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:41:00 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 33678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:41:00.462559 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f2589861-879e-4301-8451-82d14808920c tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:00.463255 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f2589861-879e-4301-8451-82d14808920c tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:00.470176 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f2589861-879e-4301-8451-82d14808920c tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:00.470620 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f2589861-879e-4301-8451-82d14808920c tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:00.471423 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f2589861-879e-4301-8451-82d14808920c tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:00.471817 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f2589861-879e-4301-8451-82d14808920c tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:00.490918 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d7f4e433-b9a2-4b8e-b34c-a14d0f1fa5a3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:00.495589 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d7f4e433-b9a2-4b8e-b34c-a14d0f1fa5a3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:00.510224 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d7f4e433-b9a2-4b8e-b34c-a14d0f1fa5a3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:00.512414 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d7f4e433-b9a2-4b8e-b34c-a14d0f1fa5a3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:00.513698 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d7f4e433-b9a2-4b8e-b34c-a14d0f1fa5a3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:00.515234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d7f4e433-b9a2-4b8e-b34c-a14d0f1fa5a3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:00.607695 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f2589861-879e-4301-8451-82d14808920c tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:00.615595 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f2589861-879e-4301-8451-82d14808920c tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1315 microversion: 2.1 time: 0.157014 Aug 10 03:41:00.616228 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 169/344] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:00 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:00.620433 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-384b4202-c896-4083-9986-ec5bc0c0c2e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:00.621041 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-384b4202-c896-4083-9986-ec5bc0c0c2e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:00.626825 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-384b4202-c896-4083-9986-ec5bc0c0c2e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:00.627278 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-384b4202-c896-4083-9986-ec5bc0c0c2e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:00.628039 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-384b4202-c896-4083-9986-ec5bc0c0c2e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:00.628538 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-384b4202-c896-4083-9986-ec5bc0c0c2e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:00.758080 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-384b4202-c896-4083-9986-ec5bc0c0c2e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:00.765918 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-384b4202-c896-4083-9986-ec5bc0c0c2e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1313 microversion: 2.1 time: 0.148168 Aug 10 03:41:00.766480 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 170/345] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:00 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:00.784874 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d7f4e433-b9a2-4b8e-b34c-a14d0f1fa5a3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:00.792363 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d7f4e433-b9a2-4b8e-b34c-a14d0f1fa5a3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1507 microversion: 2.1 time: 0.306548 Aug 10 03:41:00.793152 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 176/346] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:00 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1507 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:01.065702 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b38163f0-2f5b-4f2a-8403-cff9cbf43345 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:01.067922 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b38163f0-2f5b-4f2a-8403-cff9cbf43345 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:01.074006 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b38163f0-2f5b-4f2a-8403-cff9cbf43345 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:01.075035 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b38163f0-2f5b-4f2a-8403-cff9cbf43345 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:01.075892 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b38163f0-2f5b-4f2a-8403-cff9cbf43345 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:01.076428 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b38163f0-2f5b-4f2a-8403-cff9cbf43345 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:01.216775 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b38163f0-2f5b-4f2a-8403-cff9cbf43345 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:01.225006 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b38163f0-2f5b-4f2a-8403-cff9cbf43345 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.163019 Aug 10 03:41:01.225554 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 171/347] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:01 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:01.297780 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-40ffbcc0-ade2-4070-b33a-028e6469ef50 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:01.298765 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-40ffbcc0-ade2-4070-b33a-028e6469ef50 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:01.305929 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-40ffbcc0-ade2-4070-b33a-028e6469ef50 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:01.306567 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-40ffbcc0-ade2-4070-b33a-028e6469ef50 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:01.307526 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-40ffbcc0-ade2-4070-b33a-028e6469ef50 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:01.308235 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-40ffbcc0-ade2-4070-b33a-028e6469ef50 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:01.330580 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-f5366404-23fc-41f1-85d9-08dba2dc3a48 req-d693ffe6-1270-4988-ae5e-3f40b3dd82cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b2ff6d-182a-4e59-8e35-c72521e5a321", "tag": "728523d7-369a-49a2-937d-b2808fcdcf0c"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:01.332171 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:41:01.332171 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:41:01.340873 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-f5366404-23fc-41f1-85d9-08dba2dc3a48 req-d693ffe6-1270-4988-ae5e-3f40b3dd82cf service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:01.341406 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-f5366404-23fc-41f1-85d9-08dba2dc3a48 req-d693ffe6-1270-4988-ae5e-3f40b3dd82cf service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:01.383913 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-f5366404-23fc-41f1-85d9-08dba2dc3a48 req-d693ffe6-1270-4988-ae5e-3f40b3dd82cf service nova] Creating event network-changed:728523d7-369a-49a2-937d-b2808fcdcf0c for instance d2b2ff6d-182a-4e59-8e35-c72521e5a321 on hv-cinder-78239 Aug 10 03:41:01.388874 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-f5366404-23fc-41f1-85d9-08dba2dc3a48 req-d693ffe6-1270-4988-ae5e-3f40b3dd82cf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061704 Aug 10 03:41:01.390611 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 172/348] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:41:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:41:01.441357 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-fc617dfb-8be0-46e8-8fb1-d5d229fa6854 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:01.442253 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-fc617dfb-8be0-46e8-8fb1-d5d229fa6854 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:01.448852 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fc617dfb-8be0-46e8-8fb1-d5d229fa6854 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:01.449296 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fc617dfb-8be0-46e8-8fb1-d5d229fa6854 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:01.450256 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fc617dfb-8be0-46e8-8fb1-d5d229fa6854 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:01.450722 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fc617dfb-8be0-46e8-8fb1-d5d229fa6854 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:01.575152 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-40ffbcc0-ade2-4070-b33a-028e6469ef50 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 30264 microversion: 2.1 time: 0.282505 Aug 10 03:41:01.575803 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 177/349] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:01 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 30264 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:41:01.623539 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-fc617dfb-8be0-46e8-8fb1-d5d229fa6854 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 35394 microversion: 2.20 time: 0.189454 Aug 10 03:41:01.628168 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 173/350] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:41:01 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 35394 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:41:01.632355 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d95c5760-9252-4fc8-b676-abbf6a9b9aaf tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:01.633047 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d95c5760-9252-4fc8-b676-abbf6a9b9aaf tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:01.639811 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d95c5760-9252-4fc8-b676-abbf6a9b9aaf tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:01.640271 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d95c5760-9252-4fc8-b676-abbf6a9b9aaf tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:01.641035 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d95c5760-9252-4fc8-b676-abbf6a9b9aaf tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:01.641456 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d95c5760-9252-4fc8-b676-abbf6a9b9aaf tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:01.783462 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-72ed3b49-e852-43fb-b073-6f3cfab21531 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:01.784189 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-72ed3b49-e852-43fb-b073-6f3cfab21531 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:01.793805 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-72ed3b49-e852-43fb-b073-6f3cfab21531 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:01.794687 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-72ed3b49-e852-43fb-b073-6f3cfab21531 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:01.795632 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-72ed3b49-e852-43fb-b073-6f3cfab21531 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:01.796369 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-72ed3b49-e852-43fb-b073-6f3cfab21531 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:01.841394 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d95c5760-9252-4fc8-b676-abbf6a9b9aaf tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:01.848637 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d95c5760-9252-4fc8-b676-abbf6a9b9aaf tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1315 microversion: 2.1 time: 0.220133 Aug 10 03:41:01.849200 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 178/351] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:01 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:01.923490 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-72ed3b49-e852-43fb-b073-6f3cfab21531 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:01.931051 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-72ed3b49-e852-43fb-b073-6f3cfab21531 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1313 microversion: 2.1 time: 0.151713 Aug 10 03:41:01.932586 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 174/352] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:01 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:02.242136 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b4c679a9-b91a-49f2-b3db-e7b82c1083bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:02.243100 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b4c679a9-b91a-49f2-b3db-e7b82c1083bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:02.249329 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b4c679a9-b91a-49f2-b3db-e7b82c1083bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:02.250349 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b4c679a9-b91a-49f2-b3db-e7b82c1083bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:02.251270 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b4c679a9-b91a-49f2-b3db-e7b82c1083bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:02.251722 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b4c679a9-b91a-49f2-b3db-e7b82c1083bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:02.400022 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b4c679a9-b91a-49f2-b3db-e7b82c1083bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:02.407659 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b4c679a9-b91a-49f2-b3db-e7b82c1083bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.169372 Aug 10 03:41:02.408292 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 179/353] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:02 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:02.586944 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8c4763f2-3837-4902-ab0b-d828d9291e22 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:02.587881 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8c4763f2-3837-4902-ab0b-d828d9291e22 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:02.593729 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8c4763f2-3837-4902-ab0b-d828d9291e22 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:02.594169 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8c4763f2-3837-4902-ab0b-d828d9291e22 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:02.594920 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8c4763f2-3837-4902-ab0b-d828d9291e22 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:02.595349 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8c4763f2-3837-4902-ab0b-d828d9291e22 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:02.635356 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4227a49b-5f65-4c41-b650-0ed6ba8f8090 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:02.636354 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4227a49b-5f65-4c41-b650-0ed6ba8f8090 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:02.643185 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4227a49b-5f65-4c41-b650-0ed6ba8f8090 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:02.643631 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4227a49b-5f65-4c41-b650-0ed6ba8f8090 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:02.644426 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4227a49b-5f65-4c41-b650-0ed6ba8f8090 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:02.644856 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4227a49b-5f65-4c41-b650-0ed6ba8f8090 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:02.842608 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8c4763f2-3837-4902-ab0b-d828d9291e22 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 31256 microversion: 2.1 time: 0.259127 Aug 10 03:41:02.843158 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 175/354] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:02 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 31256 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:41:02.865946 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a47b07db-6287-4a6f-9cc6-bcdbd64ac1fe tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:02.866665 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a47b07db-6287-4a6f-9cc6-bcdbd64ac1fe tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:02.873349 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a47b07db-6287-4a6f-9cc6-bcdbd64ac1fe tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:02.873790 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a47b07db-6287-4a6f-9cc6-bcdbd64ac1fe tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:02.874589 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a47b07db-6287-4a6f-9cc6-bcdbd64ac1fe tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:02.875548 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a47b07db-6287-4a6f-9cc6-bcdbd64ac1fe tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:02.990496 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4227a49b-5f65-4c41-b650-0ed6ba8f8090 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 36693 microversion: 2.20 time: 0.358670 Aug 10 03:41:02.991438 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 180/355] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:41:02 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 36693 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:41:02.996580 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-619dab63-a175-4c63-b1b1-d4e5c27a6ac7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:02.997283 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-619dab63-a175-4c63-b1b1-d4e5c27a6ac7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:02.997821 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a47b07db-6287-4a6f-9cc6-bcdbd64ac1fe tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:03.007086 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a47b07db-6287-4a6f-9cc6-bcdbd64ac1fe tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1315 microversion: 2.1 time: 0.144890 Aug 10 03:41:03.007331 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-619dab63-a175-4c63-b1b1-d4e5c27a6ac7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:03.007688 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 176/356] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:02 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:03.007899 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-619dab63-a175-4c63-b1b1-d4e5c27a6ac7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:03.009176 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-619dab63-a175-4c63-b1b1-d4e5c27a6ac7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:03.009735 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-619dab63-a175-4c63-b1b1-d4e5c27a6ac7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:03.151423 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-619dab63-a175-4c63-b1b1-d4e5c27a6ac7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:03.158999 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-619dab63-a175-4c63-b1b1-d4e5c27a6ac7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1313 microversion: 2.1 time: 0.166304 Aug 10 03:41:03.159547 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 181/357] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:02 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:03.425025 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-56433a90-cd9c-4f99-907b-8d474968e2d2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:03.425624 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-56433a90-cd9c-4f99-907b-8d474968e2d2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:03.431639 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-56433a90-cd9c-4f99-907b-8d474968e2d2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:03.432072 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-56433a90-cd9c-4f99-907b-8d474968e2d2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:03.432895 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-56433a90-cd9c-4f99-907b-8d474968e2d2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:03.433328 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-56433a90-cd9c-4f99-907b-8d474968e2d2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:03.557625 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-56433a90-cd9c-4f99-907b-8d474968e2d2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:03.564878 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-56433a90-cd9c-4f99-907b-8d474968e2d2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.144178 Aug 10 03:41:03.565438 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 177/358] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:03 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:03.592103 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-deffe228-9b3a-4ddd-af77-f2521c50c6bb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff6b6a1c-721d-4a00-9a9a-6c116221118d"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:03.594352 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-deffe228-9b3a-4ddd-af77-f2521c50c6bb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:03.603618 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-deffe228-9b3a-4ddd-af77-f2521c50c6bb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:03.604395 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-deffe228-9b3a-4ddd-af77-f2521c50c6bb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:03.610674 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-deffe228-9b3a-4ddd-af77-f2521c50c6bb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:03.610674 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-deffe228-9b3a-4ddd-af77-f2521c50c6bb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:03.853915 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1de51f68-3b2b-4fef-92c1-9cb8ee8c5c36 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:03.854889 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1de51f68-3b2b-4fef-92c1-9cb8ee8c5c36 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:03.860903 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1de51f68-3b2b-4fef-92c1-9cb8ee8c5c36 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:03.861343 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1de51f68-3b2b-4fef-92c1-9cb8ee8c5c36 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:03.862093 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1de51f68-3b2b-4fef-92c1-9cb8ee8c5c36 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:03.862516 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1de51f68-3b2b-4fef-92c1-9cb8ee8c5c36 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:03.997817 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1de51f68-3b2b-4fef-92c1-9cb8ee8c5c36 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 31981 microversion: 2.1 time: 0.147279 Aug 10 03:41:03.998452 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 178/359] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:03 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 31981 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:41:04.003925 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e5c10927-c27b-411b-9b53-2af17bb1ba99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:04.004932 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e5c10927-c27b-411b-9b53-2af17bb1ba99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:04.011319 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5c10927-c27b-411b-9b53-2af17bb1ba99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:04.011765 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5c10927-c27b-411b-9b53-2af17bb1ba99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:04.012590 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5c10927-c27b-411b-9b53-2af17bb1ba99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:04.013025 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5c10927-c27b-411b-9b53-2af17bb1ba99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:04.160523 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e5c10927-c27b-411b-9b53-2af17bb1ba99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 36901 microversion: 2.20 time: 0.160609 Aug 10 03:41:04.161174 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 179/360] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:41:03 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 36901 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:41:04.166088 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-fc6defa3-d012-41d7-91cf-fdf312c51284 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:04.166771 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-fc6defa3-d012-41d7-91cf-fdf312c51284 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:04.174048 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fc6defa3-d012-41d7-91cf-fdf312c51284 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:04.174498 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fc6defa3-d012-41d7-91cf-fdf312c51284 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:04.175341 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fc6defa3-d012-41d7-91cf-fdf312c51284 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:04.175724 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fc6defa3-d012-41d7-91cf-fdf312c51284 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:04.302453 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-fc6defa3-d012-41d7-91cf-fdf312c51284 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:04.308798 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-fc6defa3-d012-41d7-91cf-fdf312c51284 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1315 microversion: 2.1 time: 0.146080 Aug 10 03:41:04.309168 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 180/361] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:04 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:04.316828 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-dac66bc2-6399-4049-82c2-24f87366f1f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:04.317445 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-dac66bc2-6399-4049-82c2-24f87366f1f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:04.323042 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dac66bc2-6399-4049-82c2-24f87366f1f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:04.323624 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dac66bc2-6399-4049-82c2-24f87366f1f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:04.324444 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dac66bc2-6399-4049-82c2-24f87366f1f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:04.324876 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dac66bc2-6399-4049-82c2-24f87366f1f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:04.464399 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-dac66bc2-6399-4049-82c2-24f87366f1f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:04.471906 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-dac66bc2-6399-4049-82c2-24f87366f1f7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1497 microversion: 2.1 time: 0.158781 Aug 10 03:41:04.477768 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 181/362] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:04 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:04.485958 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-deffe228-9b3a-4ddd-af77-f2521c50c6bb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "POST /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.897444 Aug 10 03:41:04.504315 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 182/363] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 10 03:41:03 2021] POST /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f/os-volume_attachments => generated 194 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:41:04.629880 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9984dfd9-5449-4dc4-8609-47c3a89b8418 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:04.629880 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9984dfd9-5449-4dc4-8609-47c3a89b8418 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:04.630361 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9984dfd9-5449-4dc4-8609-47c3a89b8418 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:04.630813 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9984dfd9-5449-4dc4-8609-47c3a89b8418 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:04.631591 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9984dfd9-5449-4dc4-8609-47c3a89b8418 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:04.632027 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9984dfd9-5449-4dc4-8609-47c3a89b8418 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:04.753412 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-9984dfd9-5449-4dc4-8609-47c3a89b8418 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:04.760658 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9984dfd9-5449-4dc4-8609-47c3a89b8418 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.143449 Aug 10 03:41:04.761214 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 182/364] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:04 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:05.011090 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e48f42e6-5505-4ae6-bc4e-e69c500ecbff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:05.012039 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e48f42e6-5505-4ae6-bc4e-e69c500ecbff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:05.019573 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e48f42e6-5505-4ae6-bc4e-e69c500ecbff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:05.020164 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e48f42e6-5505-4ae6-bc4e-e69c500ecbff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:05.026094 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e48f42e6-5505-4ae6-bc4e-e69c500ecbff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:05.026094 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e48f42e6-5505-4ae6-bc4e-e69c500ecbff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:05.161432 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e48f42e6-5505-4ae6-bc4e-e69c500ecbff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 32475 microversion: 2.1 time: 0.154775 Aug 10 03:41:05.162262 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 183/365] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:05 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 32475 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:41:05.175271 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-489b7479-65d7-4df7-bc94-509641b11e13 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:05.182803 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-489b7479-65d7-4df7-bc94-509641b11e13 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:05.189576 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-489b7479-65d7-4df7-bc94-509641b11e13 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:05.190134 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-489b7479-65d7-4df7-bc94-509641b11e13 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:05.191139 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-489b7479-65d7-4df7-bc94-509641b11e13 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:05.191647 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-489b7479-65d7-4df7-bc94-509641b11e13 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:05.326068 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1e757746-914e-474e-92b3-0e39d0de979e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:05.326758 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1e757746-914e-474e-92b3-0e39d0de979e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:05.334037 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1e757746-914e-474e-92b3-0e39d0de979e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:05.334518 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1e757746-914e-474e-92b3-0e39d0de979e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:05.335280 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1e757746-914e-474e-92b3-0e39d0de979e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:05.335701 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1e757746-914e-474e-92b3-0e39d0de979e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:05.349827 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-489b7479-65d7-4df7-bc94-509641b11e13 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 37173 microversion: 2.20 time: 0.180968 Aug 10 03:41:05.351477 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 183/366] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:41:05 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 37173 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:41:05.458067 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1e757746-914e-474e-92b3-0e39d0de979e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:05.465346 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1e757746-914e-474e-92b3-0e39d0de979e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1315 microversion: 2.1 time: 0.143258 Aug 10 03:41:05.466725 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 184/367] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:05 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:05.778304 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-dfd8e14c-2c45-4bb1-8d69-371b0d184356 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:05.779059 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-dfd8e14c-2c45-4bb1-8d69-371b0d184356 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:05.785593 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dfd8e14c-2c45-4bb1-8d69-371b0d184356 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:05.786106 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dfd8e14c-2c45-4bb1-8d69-371b0d184356 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:05.786912 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dfd8e14c-2c45-4bb1-8d69-371b0d184356 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:05.787350 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dfd8e14c-2c45-4bb1-8d69-371b0d184356 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:05.916686 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-dfd8e14c-2c45-4bb1-8d69-371b0d184356 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:05.924672 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-dfd8e14c-2c45-4bb1-8d69-371b0d184356 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.150469 Aug 10 03:41:05.925219 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 184/368] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:05 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:06.148432 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-69baae37-3795-43ba-b09f-da0d8d47cb06 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:06.148969 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-69baae37-3795-43ba-b09f-da0d8d47cb06 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:06.156697 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-69baae37-3795-43ba-b09f-da0d8d47cb06 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:06.156697 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-69baae37-3795-43ba-b09f-da0d8d47cb06 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:06.156697 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-69baae37-3795-43ba-b09f-da0d8d47cb06 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:06.156988 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-69baae37-3795-43ba-b09f-da0d8d47cb06 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:06.174457 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a2c53816-a398-4226-b0d2-ed18f1f976c8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:06.176182 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a2c53816-a398-4226-b0d2-ed18f1f976c8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:06.182076 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-69baae37-3795-43ba-b09f-da0d8d47cb06 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Going to try to terminate instance {{(pid=108440) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:41:06.185835 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a2c53816-a398-4226-b0d2-ed18f1f976c8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:06.186795 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a2c53816-a398-4226-b0d2-ed18f1f976c8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:06.187934 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a2c53816-a398-4226-b0d2-ed18f1f976c8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:06.188689 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a2c53816-a398-4226-b0d2-ed18f1f976c8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:06.348940 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a2c53816-a398-4226-b0d2-ed18f1f976c8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 33107 microversion: 2.1 time: 0.179119 Aug 10 03:41:06.349575 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 185/369] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:06 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 33107 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:41:06.364114 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1e325190-4c2a-4917-8ef1-2518b66e2a16 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:06.365289 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1e325190-4c2a-4917-8ef1-2518b66e2a16 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:06.371654 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e325190-4c2a-4917-8ef1-2518b66e2a16 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:06.372101 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e325190-4c2a-4917-8ef1-2518b66e2a16 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:06.372915 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e325190-4c2a-4917-8ef1-2518b66e2a16 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:06.373353 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e325190-4c2a-4917-8ef1-2518b66e2a16 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:06.498366 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-69baae37-3795-43ba-b09f-da0d8d47cb06 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "DELETE /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 204 len: 0 microversion: 2.1 time: 0.353338 Aug 10 03:41:06.499045 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 185/370] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:41:06 2021] DELETE /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:41:06.504149 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d7284725-2ab4-4ace-9358-2804ee5ee188 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:06.506365 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d7284725-2ab4-4ace-9358-2804ee5ee188 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:06.510770 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d7284725-2ab4-4ace-9358-2804ee5ee188 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:06.511212 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d7284725-2ab4-4ace-9358-2804ee5ee188 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:06.511975 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d7284725-2ab4-4ace-9358-2804ee5ee188 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:06.512468 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d7284725-2ab4-4ace-9358-2804ee5ee188 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:06.543225 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1e325190-4c2a-4917-8ef1-2518b66e2a16 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 37651 microversion: 2.20 time: 0.184002 Aug 10 03:41:06.548043 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 186/371] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:41:06 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 37651 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:41:06.549808 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a727055a-9a0a-49c7-84d0-29ceda6afc7f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:06.550612 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a727055a-9a0a-49c7-84d0-29ceda6afc7f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:06.557035 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a727055a-9a0a-49c7-84d0-29ceda6afc7f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:06.557693 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a727055a-9a0a-49c7-84d0-29ceda6afc7f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:06.558985 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a727055a-9a0a-49c7-84d0-29ceda6afc7f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:06.559599 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a727055a-9a0a-49c7-84d0-29ceda6afc7f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:06.644274 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d7284725-2ab4-4ace-9358-2804ee5ee188 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:06.652973 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d7284725-2ab4-4ace-9358-2804ee5ee188 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1315 microversion: 2.1 time: 0.152636 Aug 10 03:41:06.654324 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 186/372] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:06 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:06.716874 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a727055a-9a0a-49c7-84d0-29ceda6afc7f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:06.724852 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a727055a-9a0a-49c7-84d0-29ceda6afc7f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1503 microversion: 2.1 time: 0.179802 Aug 10 03:41:06.725500 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 187/373] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:06 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:06.943006 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c4a6f29e-8b6b-40a2-a79a-569c0702ab78 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:06.943621 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c4a6f29e-8b6b-40a2-a79a-569c0702ab78 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:06.949609 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c4a6f29e-8b6b-40a2-a79a-569c0702ab78 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:06.950063 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c4a6f29e-8b6b-40a2-a79a-569c0702ab78 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:06.950837 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c4a6f29e-8b6b-40a2-a79a-569c0702ab78 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:06.951272 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c4a6f29e-8b6b-40a2-a79a-569c0702ab78 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:07.303844 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c4a6f29e-8b6b-40a2-a79a-569c0702ab78 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:07.311781 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c4a6f29e-8b6b-40a2-a79a-569c0702ab78 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.373901 Aug 10 03:41:07.312975 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 187/374] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:06 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:07.361295 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2e3ca685-5459-432d-bfc6-1ad1e2677b09 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:07.362208 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2e3ca685-5459-432d-bfc6-1ad1e2677b09 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:07.368287 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2e3ca685-5459-432d-bfc6-1ad1e2677b09 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:07.368733 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2e3ca685-5459-432d-bfc6-1ad1e2677b09 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:07.369508 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2e3ca685-5459-432d-bfc6-1ad1e2677b09 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:07.369937 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2e3ca685-5459-432d-bfc6-1ad1e2677b09 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:07.484702 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2e3ca685-5459-432d-bfc6-1ad1e2677b09 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 33475 microversion: 2.1 time: 0.127784 Aug 10 03:41:07.485685 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 188/375] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:07 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 33475 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:41:07.555937 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-209f4857-4f71-4e96-8c63-0d7cb9b25a87 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:07.556971 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-209f4857-4f71-4e96-8c63-0d7cb9b25a87 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:07.562858 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-209f4857-4f71-4e96-8c63-0d7cb9b25a87 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:07.563337 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-209f4857-4f71-4e96-8c63-0d7cb9b25a87 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:07.564152 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-209f4857-4f71-4e96-8c63-0d7cb9b25a87 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:07.564611 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-209f4857-4f71-4e96-8c63-0d7cb9b25a87 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:07.671067 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3e264517-bb85-4ce1-9d25-fcca4afa2a73 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:07.671861 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3e264517-bb85-4ce1-9d25-fcca4afa2a73 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:07.678797 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3e264517-bb85-4ce1-9d25-fcca4afa2a73 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:07.679057 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3e264517-bb85-4ce1-9d25-fcca4afa2a73 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:07.679929 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3e264517-bb85-4ce1-9d25-fcca4afa2a73 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:07.680398 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3e264517-bb85-4ce1-9d25-fcca4afa2a73 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:07.702382 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-209f4857-4f71-4e96-8c63-0d7cb9b25a87 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 38053 microversion: 2.20 time: 0.150060 Aug 10 03:41:07.703550 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 188/376] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:41:07 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 38053 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:41:07.756468 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f6cff35b-db13-46a5-8f1e-f5681b3cbd9d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:07.756468 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f6cff35b-db13-46a5-8f1e-f5681b3cbd9d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:07.759490 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6cff35b-db13-46a5-8f1e-f5681b3cbd9d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:07.759490 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6cff35b-db13-46a5-8f1e-f5681b3cbd9d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:07.759490 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6cff35b-db13-46a5-8f1e-f5681b3cbd9d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:07.759490 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6cff35b-db13-46a5-8f1e-f5681b3cbd9d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:07.812507 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3e264517-bb85-4ce1-9d25-fcca4afa2a73 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:07.820235 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3e264517-bb85-4ce1-9d25-fcca4afa2a73 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1315 microversion: 2.1 time: 0.153334 Aug 10 03:41:07.821074 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 189/377] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:07 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:07.906613 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f6cff35b-db13-46a5-8f1e-f5681b3cbd9d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:07.914370 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f6cff35b-db13-46a5-8f1e-f5681b3cbd9d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1503 microversion: 2.1 time: 0.169516 Aug 10 03:41:07.920746 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 189/378] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:07 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:08.330006 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-71d05089-ffef-4503-8d09-121681ccf05f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:08.330708 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-71d05089-ffef-4503-8d09-121681ccf05f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:08.336952 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-71d05089-ffef-4503-8d09-121681ccf05f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:08.337474 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-71d05089-ffef-4503-8d09-121681ccf05f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:08.338312 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-71d05089-ffef-4503-8d09-121681ccf05f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:08.338805 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-71d05089-ffef-4503-8d09-121681ccf05f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:08.472094 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-71d05089-ffef-4503-8d09-121681ccf05f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:08.479994 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-71d05089-ffef-4503-8d09-121681ccf05f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.154188 Aug 10 03:41:08.480675 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 190/379] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:08 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:08.496378 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-98b4a60e-d308-4fa4-9fb1-4a7c14decee7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:08.497291 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-98b4a60e-d308-4fa4-9fb1-4a7c14decee7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:08.503560 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-98b4a60e-d308-4fa4-9fb1-4a7c14decee7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:08.504003 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-98b4a60e-d308-4fa4-9fb1-4a7c14decee7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:08.504803 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-98b4a60e-d308-4fa4-9fb1-4a7c14decee7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:08.505234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-98b4a60e-d308-4fa4-9fb1-4a7c14decee7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:08.710153 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-98b4a60e-d308-4fa4-9fb1-4a7c14decee7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 34051 microversion: 2.1 time: 0.217107 Aug 10 03:41:08.710696 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 190/380] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:08 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 34051 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:41:08.714838 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c1d77cec-8bd1-4a24-b849-b360d9ae9f16 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:08.715834 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c1d77cec-8bd1-4a24-b849-b360d9ae9f16 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:08.722089 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c1d77cec-8bd1-4a24-b849-b360d9ae9f16 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:08.722533 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c1d77cec-8bd1-4a24-b849-b360d9ae9f16 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:08.723292 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c1d77cec-8bd1-4a24-b849-b360d9ae9f16 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:08.723719 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c1d77cec-8bd1-4a24-b849-b360d9ae9f16 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:08.838726 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-bc787bd6-7c0f-4559-9101-c463272e6d34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:08.839519 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-bc787bd6-7c0f-4559-9101-c463272e6d34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:08.845978 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bc787bd6-7c0f-4559-9101-c463272e6d34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:08.846413 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bc787bd6-7c0f-4559-9101-c463272e6d34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:08.847169 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bc787bd6-7c0f-4559-9101-c463272e6d34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:08.847597 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bc787bd6-7c0f-4559-9101-c463272e6d34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:08.902761 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c1d77cec-8bd1-4a24-b849-b360d9ae9f16 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 38053 microversion: 2.20 time: 0.191361 Aug 10 03:41:08.904131 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 191/381] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:41:08 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 38053 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:41:08.931207 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-58b60b99-6ea7-4bb3-87db-624f524fd92e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:08.936421 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-58b60b99-6ea7-4bb3-87db-624f524fd92e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:08.939067 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-58b60b99-6ea7-4bb3-87db-624f524fd92e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:08.939572 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-58b60b99-6ea7-4bb3-87db-624f524fd92e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:08.940384 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-58b60b99-6ea7-4bb3-87db-624f524fd92e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:08.940819 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-58b60b99-6ea7-4bb3-87db-624f524fd92e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:08.978515 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-bc787bd6-7c0f-4559-9101-c463272e6d34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:08.986726 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-bc787bd6-7c0f-4559-9101-c463272e6d34 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1315 microversion: 2.1 time: 0.152459 Aug 10 03:41:08.987272 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 191/382] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:08 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:09.073196 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-58b60b99-6ea7-4bb3-87db-624f524fd92e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:09.080391 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-58b60b99-6ea7-4bb3-87db-624f524fd92e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1503 microversion: 2.1 time: 0.153246 Aug 10 03:41:09.080948 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 192/383] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:08 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:09.497315 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-cbe06e87-7108-4716-b7d3-a5db1df67151 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:09.498044 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-cbe06e87-7108-4716-b7d3-a5db1df67151 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:09.505182 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cbe06e87-7108-4716-b7d3-a5db1df67151 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:09.505704 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cbe06e87-7108-4716-b7d3-a5db1df67151 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:09.506544 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cbe06e87-7108-4716-b7d3-a5db1df67151 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:09.507053 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cbe06e87-7108-4716-b7d3-a5db1df67151 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:09.707076 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-cbe06e87-7108-4716-b7d3-a5db1df67151 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:09.714567 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-cbe06e87-7108-4716-b7d3-a5db1df67151 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.220990 Aug 10 03:41:09.715444 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 192/384] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:09 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:09.721942 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-55556be6-9c79-4013-987f-3733c9031847 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:09.722879 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-55556be6-9c79-4013-987f-3733c9031847 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:09.728633 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-55556be6-9c79-4013-987f-3733c9031847 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:09.729075 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-55556be6-9c79-4013-987f-3733c9031847 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:09.729832 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-55556be6-9c79-4013-987f-3733c9031847 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:09.730334 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-55556be6-9c79-4013-987f-3733c9031847 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:09.844187 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-55556be6-9c79-4013-987f-3733c9031847 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 34787 microversion: 2.1 time: 0.125397 Aug 10 03:41:09.845879 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 193/385] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:09 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 34787 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:41:09.888775 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-64370a2d-aa59-40ab-8a1c-30f5614ee589 req-83609312-1851-4416-bbfe-7c94190b1cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8075af1-76b3-46a2-809d-87d7cb03d811", "name": "network-vif-deleted", "tag": "4e279ed4-c72e-4d9c-a351-411e196088fc"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:09.890815 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:41:09.890815 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:41:09.898424 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-64370a2d-aa59-40ab-8a1c-30f5614ee589 req-83609312-1851-4416-bbfe-7c94190b1cad service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:09.898862 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-64370a2d-aa59-40ab-8a1c-30f5614ee589 req-83609312-1851-4416-bbfe-7c94190b1cad service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:09.910717 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-64370a2d-aa59-40ab-8a1c-30f5614ee589 req-83609312-1851-4416-bbfe-7c94190b1cad service nova] Creating event network-vif-deleted:4e279ed4-c72e-4d9c-a351-411e196088fc for instance e8075af1-76b3-46a2-809d-87d7cb03d811 on hv-cinder-78239 Aug 10 03:41:09.916460 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-64370a2d-aa59-40ab-8a1c-30f5614ee589 req-83609312-1851-4416-bbfe-7c94190b1cad service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031114 Aug 10 03:41:09.917076 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8d005512-bb6d-48f3-a380-bd0f405a45bf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:09.917253 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 193/386] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:41:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:41:09.918436 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8d005512-bb6d-48f3-a380-bd0f405a45bf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:09.925081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8d005512-bb6d-48f3-a380-bd0f405a45bf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:09.925615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8d005512-bb6d-48f3-a380-bd0f405a45bf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:09.926392 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8d005512-bb6d-48f3-a380-bd0f405a45bf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:09.926819 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8d005512-bb6d-48f3-a380-bd0f405a45bf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:10.005158 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a42263c8-d924-4313-b442-a05e8a9953b7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:10.005876 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a42263c8-d924-4313-b442-a05e8a9953b7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:10.012062 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a42263c8-d924-4313-b442-a05e8a9953b7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:10.012568 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a42263c8-d924-4313-b442-a05e8a9953b7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:10.013326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a42263c8-d924-4313-b442-a05e8a9953b7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:10.013754 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a42263c8-d924-4313-b442-a05e8a9953b7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:10.025755 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8d005512-bb6d-48f3-a380-bd0f405a45bf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 38053 microversion: 2.20 time: 0.113963 Aug 10 03:41:10.026399 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 194/387] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:41:09 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 38053 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:41:10.097681 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-52242ab2-68ea-45b1-8595-bc591c1bfdf3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:10.098373 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-52242ab2-68ea-45b1-8595-bc591c1bfdf3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:10.106017 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-52242ab2-68ea-45b1-8595-bc591c1bfdf3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:10.113370 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-52242ab2-68ea-45b1-8595-bc591c1bfdf3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:10.119120 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-52242ab2-68ea-45b1-8595-bc591c1bfdf3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:10.119610 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-52242ab2-68ea-45b1-8595-bc591c1bfdf3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:10.164525 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a42263c8-d924-4313-b442-a05e8a9953b7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:10.168678 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a42263c8-d924-4313-b442-a05e8a9953b7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1315 microversion: 2.1 time: 0.167826 Aug 10 03:41:10.169437 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 194/388] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:09 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:10.188482 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-52242ab2-68ea-45b1-8595-bc591c1bfdf3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:10.195868 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-52242ab2-68ea-45b1-8595-bc591c1bfdf3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1298 microversion: 2.1 time: 0.102123 Aug 10 03:41:10.196478 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 195/389] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:10 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1298 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:10.250126 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-c555f8a9-60ea-4e68-9586-3b044d3d5e36 req-fb30f752-cd0b-4dc0-becf-238f39589f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b2ff6d-182a-4e59-8e35-c72521e5a321", "name": "network-vif-plugged", "status": "completed", "tag": "728523d7-369a-49a2-937d-b2808fcdcf0c"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:10.251634 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:41:10.251634 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:41:10.260181 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-c555f8a9-60ea-4e68-9586-3b044d3d5e36 req-fb30f752-cd0b-4dc0-becf-238f39589f57 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:10.260867 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-c555f8a9-60ea-4e68-9586-3b044d3d5e36 req-fb30f752-cd0b-4dc0-becf-238f39589f57 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:10.273919 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-c555f8a9-60ea-4e68-9586-3b044d3d5e36 req-fb30f752-cd0b-4dc0-becf-238f39589f57 service nova] Creating event network-vif-plugged:728523d7-369a-49a2-937d-b2808fcdcf0c for instance d2b2ff6d-182a-4e59-8e35-c72521e5a321 on hv-cinder-78239 Aug 10 03:41:10.279186 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-c555f8a9-60ea-4e68-9586-3b044d3d5e36 req-fb30f752-cd0b-4dc0-becf-238f39589f57 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033172 Aug 10 03:41:10.279760 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 195/390] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:41:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:41:10.731321 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2a5ac84f-9d38-47dd-af86-42e25ab05851 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:10.731851 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2a5ac84f-9d38-47dd-af86-42e25ab05851 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:10.738065 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2a5ac84f-9d38-47dd-af86-42e25ab05851 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:10.738502 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2a5ac84f-9d38-47dd-af86-42e25ab05851 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:10.739252 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2a5ac84f-9d38-47dd-af86-42e25ab05851 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:10.739674 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2a5ac84f-9d38-47dd-af86-42e25ab05851 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:10.856583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ec6256e7-a86f-491d-b1a7-404f069c1483 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:10.857597 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ec6256e7-a86f-491d-b1a7-404f069c1483 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:10.861406 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2a5ac84f-9d38-47dd-af86-42e25ab05851 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:10.863821 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ec6256e7-a86f-491d-b1a7-404f069c1483 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:10.864284 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ec6256e7-a86f-491d-b1a7-404f069c1483 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:10.865250 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ec6256e7-a86f-491d-b1a7-404f069c1483 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:10.865717 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ec6256e7-a86f-491d-b1a7-404f069c1483 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:10.868905 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2a5ac84f-9d38-47dd-af86-42e25ab05851 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.141333 Aug 10 03:41:10.869462 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 196/391] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:10 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:11.037263 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-15645119-8ea9-49ad-812c-dca2839c2359 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:11.038095 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-15645119-8ea9-49ad-812c-dca2839c2359 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:11.043849 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-15645119-8ea9-49ad-812c-dca2839c2359 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:11.044334 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-15645119-8ea9-49ad-812c-dca2839c2359 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:11.045094 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-15645119-8ea9-49ad-812c-dca2839c2359 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:11.045522 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-15645119-8ea9-49ad-812c-dca2839c2359 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:11.050998 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ec6256e7-a86f-491d-b1a7-404f069c1483 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 35596 microversion: 2.1 time: 0.198348 Aug 10 03:41:11.052236 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 196/392] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:10 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 35596 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:41:11.167730 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-15645119-8ea9-49ad-812c-dca2839c2359 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 38053 microversion: 2.20 time: 0.134117 Aug 10 03:41:11.168389 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 197/393] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:41:11 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 38053 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:41:11.186223 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-52bc18bb-565f-458f-a3bd-6bf309ea7adb tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:11.187521 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-52bc18bb-565f-458f-a3bd-6bf309ea7adb tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:11.194115 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-52bc18bb-565f-458f-a3bd-6bf309ea7adb tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:11.194557 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-52bc18bb-565f-458f-a3bd-6bf309ea7adb tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:11.195326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-52bc18bb-565f-458f-a3bd-6bf309ea7adb tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:11.195757 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-52bc18bb-565f-458f-a3bd-6bf309ea7adb tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:11.215699 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-bb65a76b-1116-46dc-8e30-2bb12df174c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:11.224909 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-bb65a76b-1116-46dc-8e30-2bb12df174c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:11.227843 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bb65a76b-1116-46dc-8e30-2bb12df174c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:11.228602 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bb65a76b-1116-46dc-8e30-2bb12df174c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:11.229847 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bb65a76b-1116-46dc-8e30-2bb12df174c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:11.230559 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bb65a76b-1116-46dc-8e30-2bb12df174c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:11.263596 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bb65a76b-1116-46dc-8e30-2bb12df174c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:11.264032 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bb65a76b-1116-46dc-8e30-2bb12df174c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:11.264504 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-bb65a76b-1116-46dc-8e30-2bb12df174c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lazy-loading 'fault' on Instance uuid e8075af1-76b3-46a2-809d-87d7cb03d811 {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:41:11.320306 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bb65a76b-1116-46dc-8e30-2bb12df174c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:11.328946 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-bb65a76b-1116-46dc-8e30-2bb12df174c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 200 len: 1303 microversion: 2.1 time: 0.119369 Aug 10 03:41:11.329489 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 198/394] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:11 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:11.340866 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-52bc18bb-565f-458f-a3bd-6bf309ea7adb tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:11.348627 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-52bc18bb-565f-458f-a3bd-6bf309ea7adb tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1315 microversion: 2.1 time: 0.166559 Aug 10 03:41:11.349212 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 197/395] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:11 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:11.886026 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3f6d60e8-26af-4210-bfed-5224cb280db8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:11.886629 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3f6d60e8-26af-4210-bfed-5224cb280db8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:11.893059 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3f6d60e8-26af-4210-bfed-5224cb280db8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:11.893520 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3f6d60e8-26af-4210-bfed-5224cb280db8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:11.894287 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3f6d60e8-26af-4210-bfed-5224cb280db8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:11.894726 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3f6d60e8-26af-4210-bfed-5224cb280db8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:12.017854 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3f6d60e8-26af-4210-bfed-5224cb280db8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:12.025331 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3f6d60e8-26af-4210-bfed-5224cb280db8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.143116 Aug 10 03:41:12.025911 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 199/396] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:11 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:12.062732 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a592beeb-7be8-47c5-9e48-9152566a73f4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:12.063640 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a592beeb-7be8-47c5-9e48-9152566a73f4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:12.069464 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a592beeb-7be8-47c5-9e48-9152566a73f4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:12.069909 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a592beeb-7be8-47c5-9e48-9152566a73f4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:12.070677 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a592beeb-7be8-47c5-9e48-9152566a73f4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:12.071106 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a592beeb-7be8-47c5-9e48-9152566a73f4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:12.182028 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c55a1ef9-17b8-4e44-9c21-7a39a2938552 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:12.182922 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c55a1ef9-17b8-4e44-9c21-7a39a2938552 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:12.188776 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c55a1ef9-17b8-4e44-9c21-7a39a2938552 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:12.189221 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c55a1ef9-17b8-4e44-9c21-7a39a2938552 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:12.189986 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c55a1ef9-17b8-4e44-9c21-7a39a2938552 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:12.190413 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c55a1ef9-17b8-4e44-9c21-7a39a2938552 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:12.235993 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a592beeb-7be8-47c5-9e48-9152566a73f4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 36316 microversion: 2.1 time: 0.176470 Aug 10 03:41:12.236658 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 198/397] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:12 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 36316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:41:12.346532 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-623bbcbf-3af2-4042-a8b4-0cff688ef411 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:12.347265 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-623bbcbf-3af2-4042-a8b4-0cff688ef411 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: e8075af1-76b3-46a2-809d-87d7cb03d811] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:12.353766 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-623bbcbf-3af2-4042-a8b4-0cff688ef411 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:12.354221 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-623bbcbf-3af2-4042-a8b4-0cff688ef411 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:12.354959 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-623bbcbf-3af2-4042-a8b4-0cff688ef411 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:12.355382 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-623bbcbf-3af2-4042-a8b4-0cff688ef411 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:12.360153 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c55a1ef9-17b8-4e44-9c21-7a39a2938552 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 38053 microversion: 2.20 time: 0.182584 Aug 10 03:41:12.361315 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 200/398] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:41:12 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 38053 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:41:12.366033 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-89ff4b12-e7cc-4656-8ae5-189289f8fe60 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:12.366668 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-89ff4b12-e7cc-4656-8ae5-189289f8fe60 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:12.369234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-623bbcbf-3af2-4042-a8b4-0cff688ef411 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] HTTP exception thrown: Instance e8075af1-76b3-46a2-809d-87d7cb03d811 could not be found. Aug 10 03:41:12.376001 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-623bbcbf-3af2-4042-a8b4-0cff688ef411 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Returning 404 to user: Instance e8075af1-76b3-46a2-809d-87d7cb03d811 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:41:12.376001 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-623bbcbf-3af2-4042-a8b4-0cff688ef411 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811" status: 404 len: 111 microversion: 2.1 time: 0.028245 Aug 10 03:41:12.376001 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 199/399] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:12 2021] GET /compute/v2.1/servers/e8075af1-76b3-46a2-809d-87d7cb03d811 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 03:41:12.376265 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-89ff4b12-e7cc-4656-8ae5-189289f8fe60 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:12.376265 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-89ff4b12-e7cc-4656-8ae5-189289f8fe60 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:12.376265 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-89ff4b12-e7cc-4656-8ae5-189289f8fe60 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:12.376265 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-89ff4b12-e7cc-4656-8ae5-189289f8fe60 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:12.498101 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-89ff4b12-e7cc-4656-8ae5-189289f8fe60 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:12.506460 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-89ff4b12-e7cc-4656-8ae5-189289f8fe60 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1315 microversion: 2.1 time: 0.144205 Aug 10 03:41:12.507021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 201/400] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:12 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:12.508893 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-33690087", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452", "networks": [{"uuid": "ecebe461-ac2a-4cc3-81e9-d8b51a7bb890"}]}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:12.562311 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.network.neutron [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] validate_networks() for [('ecebe461-ac2a-4cc3-81e9-d8b51a7bb890', None, None, None)] {{(pid=108440) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:41:12.917623 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Flavor limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:41:12.918043 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Image limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:41:12.918515 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Flavor pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:41:12.918921 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Image pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:41:12.919331 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:41:12.927909 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:12.928394 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:12.929197 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:12.929629 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:12.945570 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Getting quotas for project 46fb8b2b63114fd68f07ec997a49a162. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:41:12.950880 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Getting quotas for user 84491dcbe2d1410a8d7557538c91c204 and project 46fb8b2b63114fd68f07ec997a49a162. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:41:12.966773 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Going to run 1 instances... {{(pid=108440) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:41:12.973907 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:41:13.042523 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e71b04e4-d59f-45da-8a4c-96f3f15490e6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:13.043211 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e71b04e4-d59f-45da-8a4c-96f3f15490e6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:13.048985 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e71b04e4-d59f-45da-8a4c-96f3f15490e6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:13.049476 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e71b04e4-d59f-45da-8a4c-96f3f15490e6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:13.050181 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e71b04e4-d59f-45da-8a4c-96f3f15490e6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:13.050594 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e71b04e4-d59f-45da-8a4c-96f3f15490e6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:13.184601 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e71b04e4-d59f-45da-8a4c-96f3f15490e6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:13.192537 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e71b04e4-d59f-45da-8a4c-96f3f15490e6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.153624 Aug 10 03:41:13.195658 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 202/401] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:13 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:13.250827 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-67ff4232-4080-42aa-9d03-be65e972caf6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:13.251933 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-67ff4232-4080-42aa-9d03-be65e972caf6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:13.258897 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-67ff4232-4080-42aa-9d03-be65e972caf6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:13.259338 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-67ff4232-4080-42aa-9d03-be65e972caf6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:13.260353 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-67ff4232-4080-42aa-9d03-be65e972caf6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:13.260784 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-67ff4232-4080-42aa-9d03-be65e972caf6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:13.283008 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-71f9e04d-3467-4423-bff7-ab6cc5f9dcca tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.778223 Aug 10 03:41:13.292479 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 200/402] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:41:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 03:41:13.297525 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6b4c520e-491d-405b-ad57-c7e605a32085 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:13.298139 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6b4c520e-491d-405b-ad57-c7e605a32085 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:13.358010 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6b4c520e-491d-405b-ad57-c7e605a32085 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:13.369875 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6b4c520e-491d-405b-ad57-c7e605a32085 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1212 microversion: 2.1 time: 0.076039 Aug 10 03:41:13.370491 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 201/403] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:13 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1212 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:13.377908 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-86e02bc1-642d-4c2c-86d2-220986d1a4f8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:13.377908 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-86e02bc1-642d-4c2c-86d2-220986d1a4f8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:13.382732 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-86e02bc1-642d-4c2c-86d2-220986d1a4f8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:13.383176 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-86e02bc1-642d-4c2c-86d2-220986d1a4f8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:13.383948 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-86e02bc1-642d-4c2c-86d2-220986d1a4f8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:13.384410 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-86e02bc1-642d-4c2c-86d2-220986d1a4f8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:13.438050 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-67ff4232-4080-42aa-9d03-be65e972caf6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 36852 microversion: 2.1 time: 0.194384 Aug 10 03:41:13.438700 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 203/404] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:13 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 36852 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:41:13.523284 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-29f6a62e-d8a0-433c-9602-23cffdd34152 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:13.523986 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-29f6a62e-d8a0-433c-9602-23cffdd34152 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:13.535698 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-29f6a62e-d8a0-433c-9602-23cffdd34152 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:13.536219 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-29f6a62e-d8a0-433c-9602-23cffdd34152 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:13.537199 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-29f6a62e-d8a0-433c-9602-23cffdd34152 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:13.537798 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-29f6a62e-d8a0-433c-9602-23cffdd34152 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:13.574935 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-86e02bc1-642d-4c2c-86d2-220986d1a4f8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 200 len: 38193 microversion: 2.20 time: 0.203008 Aug 10 03:41:13.575688 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 202/405] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:41:13 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 38193 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:41:13.590074 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-2c918f9b-96af-4d91-97c8-a54af60d4496 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:13.590675 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-2c918f9b-96af-4d91-97c8-a54af60d4496 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:13.598809 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2c918f9b-96af-4d91-97c8-a54af60d4496 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:13.603496 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2c918f9b-96af-4d91-97c8-a54af60d4496 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:13.603496 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2c918f9b-96af-4d91-97c8-a54af60d4496 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:13.603496 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2c918f9b-96af-4d91-97c8-a54af60d4496 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:13.634487 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-2c918f9b-96af-4d91-97c8-a54af60d4496 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/ips" status: 200 len: 151 microversion: 2.20 time: 0.051680 Aug 10 03:41:13.642299 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 203/406] 10.222.0.21 () {60 vars in 1289 bytes} [Tue Aug 10 03:41:13 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/ips => generated 151 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:41:13.705909 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-29f6a62e-d8a0-433c-9602-23cffdd34152 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:13.713729 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-29f6a62e-d8a0-433c-9602-23cffdd34152 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1465 microversion: 2.1 time: 0.194331 Aug 10 03:41:13.714705 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 204/407] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:13 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1465 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:13.757425 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8e61558f-49e0-4a48-bfca-06ff3fece17d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:13.757911 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8e61558f-49e0-4a48-bfca-06ff3fece17d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:13.763580 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8e61558f-49e0-4a48-bfca-06ff3fece17d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:13.764029 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8e61558f-49e0-4a48-bfca-06ff3fece17d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:13.764833 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8e61558f-49e0-4a48-bfca-06ff3fece17d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:13.765887 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8e61558f-49e0-4a48-bfca-06ff3fece17d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:13.790508 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8e61558f-49e0-4a48-bfca-06ff3fece17d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Going to try to terminate instance {{(pid=108440) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:41:14.211658 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-84c9500b-687d-4136-9b81-2c88a46ad4ea tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:14.212279 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-84c9500b-687d-4136-9b81-2c88a46ad4ea tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:14.218244 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84c9500b-687d-4136-9b81-2c88a46ad4ea tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:14.218499 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8e61558f-49e0-4a48-bfca-06ff3fece17d tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 204 len: 0 microversion: 2.1 time: 0.464241 Aug 10 03:41:14.218686 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84c9500b-687d-4136-9b81-2c88a46ad4ea tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:14.219641 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 204/408] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:41:13 2021] DELETE /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 03:41:14.222372 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84c9500b-687d-4136-9b81-2c88a46ad4ea tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:14.227875 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84c9500b-687d-4136-9b81-2c88a46ad4ea tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:14.228708 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-178e9047-87d5-4ca6-b50e-9a797f8f765f tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:14.229410 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-178e9047-87d5-4ca6-b50e-9a797f8f765f tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:14.236071 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-178e9047-87d5-4ca6-b50e-9a797f8f765f tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:14.236585 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-178e9047-87d5-4ca6-b50e-9a797f8f765f tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:14.237356 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-178e9047-87d5-4ca6-b50e-9a797f8f765f tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:14.237787 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-178e9047-87d5-4ca6-b50e-9a797f8f765f tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:14.365307 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-84c9500b-687d-4136-9b81-2c88a46ad4ea tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:14.376166 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-178e9047-87d5-4ca6-b50e-9a797f8f765f tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:14.382843 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-84c9500b-687d-4136-9b81-2c88a46ad4ea tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.165509 Aug 10 03:41:14.383541 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-178e9047-87d5-4ca6-b50e-9a797f8f765f tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1471 microversion: 2.1 time: 0.158856 Aug 10 03:41:14.384110 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 205/409] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:14 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:14.386485 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 205/410] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:14 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:14.388590 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-273ace6b-fa1c-49ed-bd1a-77e267628771 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:14.389192 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-273ace6b-fa1c-49ed-bd1a-77e267628771 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:14.442129 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-273ace6b-fa1c-49ed-bd1a-77e267628771 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:14.449553 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-273ace6b-fa1c-49ed-bd1a-77e267628771 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1212 microversion: 2.1 time: 0.064363 Aug 10 03:41:14.450115 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 206/411] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:14 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1212 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:14.453009 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ea8e6f37-3475-4e80-b0e9-d49bea1d24eb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:14.453009 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ea8e6f37-3475-4e80-b0e9-d49bea1d24eb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:14.457737 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ea8e6f37-3475-4e80-b0e9-d49bea1d24eb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:14.458181 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ea8e6f37-3475-4e80-b0e9-d49bea1d24eb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:14.459182 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ea8e6f37-3475-4e80-b0e9-d49bea1d24eb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:14.459618 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ea8e6f37-3475-4e80-b0e9-d49bea1d24eb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:14.589402 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ea8e6f37-3475-4e80-b0e9-d49bea1d24eb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 37651 microversion: 2.1 time: 0.142715 Aug 10 03:41:14.594363 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 206/412] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:14 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 37651 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:41:14.787959 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ede1e9d6-7683-4b50-b259-7c6e87ac3504 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff6b6a1c-721d-4a00-9a9a-6c116221118d"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:14.787959 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ede1e9d6-7683-4b50-b259-7c6e87ac3504 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:14.792343 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ede1e9d6-7683-4b50-b259-7c6e87ac3504 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:14.792792 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ede1e9d6-7683-4b50-b259-7c6e87ac3504 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:14.793568 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ede1e9d6-7683-4b50-b259-7c6e87ac3504 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:14.793991 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ede1e9d6-7683-4b50-b259-7c6e87ac3504 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:14.881051 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-ede1e9d6-7683-4b50-b259-7c6e87ac3504 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] HTTP exception thrown: Invalid volume: volume ff6b6a1c-721d-4a00-9a9a-6c116221118d is already attached to instances: f338fd01-6509-4b6f-815f-b6686013e38f Aug 10 03:41:14.881688 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ede1e9d6-7683-4b50-b259-7c6e87ac3504 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Returning 400 to user: Invalid volume: volume ff6b6a1c-721d-4a00-9a9a-6c116221118d is already attached to instances: f338fd01-6509-4b6f-815f-b6686013e38f {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:41:14.882573 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ede1e9d6-7683-4b50-b259-7c6e87ac3504 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "POST /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104974 Aug 10 03:41:14.883075 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 207/413] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 10 03:41:14 2021] POST /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 03:41:14.947365 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8f9f122b-70b9-46f4-a766-04107c65b4eb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:14.947936 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8f9f122b-70b9-46f4-a766-04107c65b4eb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:14.954272 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f9f122b-70b9-46f4-a766-04107c65b4eb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:14.954702 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f9f122b-70b9-46f4-a766-04107c65b4eb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:14.955452 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f9f122b-70b9-46f4-a766-04107c65b4eb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:14.955875 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f9f122b-70b9-46f4-a766-04107c65b4eb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:15.085152 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-8f9f122b-70b9-46f4-a766-04107c65b4eb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lazy-loading 'services' on Instance uuid f338fd01-6509-4b6f-815f-b6686013e38f {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:41:15.401332 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-40a540da-6b37-46c0-aba0-7824ab59a982 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:15.402052 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-40a540da-6b37-46c0-aba0-7824ab59a982 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:15.408410 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-40a540da-6b37-46c0-aba0-7824ab59a982 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:15.408857 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-40a540da-6b37-46c0-aba0-7824ab59a982 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:15.409632 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-40a540da-6b37-46c0-aba0-7824ab59a982 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:15.410086 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-40a540da-6b37-46c0-aba0-7824ab59a982 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:15.441416 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8f9f122b-70b9-46f4-a766-04107c65b4eb tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f/os-volume_attachments/ff6b6a1c-721d-4a00-9a9a-6c116221118d" status: 202 len: 0 microversion: 2.1 time: 0.497894 Aug 10 03:41:15.450984 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 207/414] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 10 03:41:14 2021] DELETE /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f/os-volume_attachments/ff6b6a1c-721d-4a00-9a9a-6c116221118d => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:41:15.450984 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1b8a9d96-5fce-44af-9332-f862fa1a86a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:15.450984 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1b8a9d96-5fce-44af-9332-f862fa1a86a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:15.455580 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1b8a9d96-5fce-44af-9332-f862fa1a86a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:15.455935 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1b8a9d96-5fce-44af-9332-f862fa1a86a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:15.456827 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1b8a9d96-5fce-44af-9332-f862fa1a86a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:15.457339 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1b8a9d96-5fce-44af-9332-f862fa1a86a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:15.562274 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-40a540da-6b37-46c0-aba0-7824ab59a982 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:15.569731 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-40a540da-6b37-46c0-aba0-7824ab59a982 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1471 microversion: 2.1 time: 0.172048 Aug 10 03:41:15.570293 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 208/415] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:15 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:15.575159 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-15ad0789-6b62-413d-83ba-da71c9468e46 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:15.576346 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-15ad0789-6b62-413d-83ba-da71c9468e46 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:15.587491 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-15ad0789-6b62-413d-83ba-da71c9468e46 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:15.588751 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-15ad0789-6b62-413d-83ba-da71c9468e46 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:15.590043 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-15ad0789-6b62-413d-83ba-da71c9468e46 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:15.591116 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-15ad0789-6b62-413d-83ba-da71c9468e46 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:15.599805 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1b8a9d96-5fce-44af-9332-f862fa1a86a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:15.607408 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1b8a9d96-5fce-44af-9332-f862fa1a86a0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.164007 Aug 10 03:41:15.608479 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 208/416] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:15 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:15.621732 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c2e369fb-6ba7-4b26-8b2e-74ac07c9ad65 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:15.622343 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c2e369fb-6ba7-4b26-8b2e-74ac07c9ad65 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:15.628843 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c2e369fb-6ba7-4b26-8b2e-74ac07c9ad65 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:15.629327 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c2e369fb-6ba7-4b26-8b2e-74ac07c9ad65 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:15.630039 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c2e369fb-6ba7-4b26-8b2e-74ac07c9ad65 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:15.630471 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c2e369fb-6ba7-4b26-8b2e-74ac07c9ad65 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:15.632258 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-15ad0789-6b62-413d-83ba-da71c9468e46 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060734 Aug 10 03:41:15.632985 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 209/417] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:41:15 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:41:15.639791 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-deade44b-b3ff-4493-8363-1b8838a18f8a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:15.640921 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-deade44b-b3ff-4493-8363-1b8838a18f8a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:15.646862 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-deade44b-b3ff-4493-8363-1b8838a18f8a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:15.647673 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-deade44b-b3ff-4493-8363-1b8838a18f8a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:15.648057 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-deade44b-b3ff-4493-8363-1b8838a18f8a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:15.648711 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-deade44b-b3ff-4493-8363-1b8838a18f8a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:15.705987 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c2e369fb-6ba7-4b26-8b2e-74ac07c9ad65 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:15.722940 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c2e369fb-6ba7-4b26-8b2e-74ac07c9ad65 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1264 microversion: 2.1 time: 0.104511 Aug 10 03:41:15.722940 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 209/418] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:15 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1264 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:15.797853 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-deade44b-b3ff-4493-8363-1b8838a18f8a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 38089 microversion: 2.1 time: 0.163200 Aug 10 03:41:15.798337 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 210/419] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:15 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 38089 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:41:16.587363 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ae411637-eb45-403b-8ba9-59fcb255e184 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:16.588011 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ae411637-eb45-403b-8ba9-59fcb255e184 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:16.594718 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ae411637-eb45-403b-8ba9-59fcb255e184 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:16.596846 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ae411637-eb45-403b-8ba9-59fcb255e184 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:16.596846 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ae411637-eb45-403b-8ba9-59fcb255e184 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:16.596846 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ae411637-eb45-403b-8ba9-59fcb255e184 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:16.627680 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d56f59f4-e889-4a6e-aafb-358a127cdf3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:16.628997 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d56f59f4-e889-4a6e-aafb-358a127cdf3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:16.636026 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d56f59f4-e889-4a6e-aafb-358a127cdf3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:16.636529 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d56f59f4-e889-4a6e-aafb-358a127cdf3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:16.637480 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d56f59f4-e889-4a6e-aafb-358a127cdf3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:16.638054 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d56f59f4-e889-4a6e-aafb-358a127cdf3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:16.741110 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ae411637-eb45-403b-8ba9-59fcb255e184 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:16.749941 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ae411637-eb45-403b-8ba9-59fcb255e184 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1471 microversion: 2.1 time: 0.165685 Aug 10 03:41:16.751187 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 210/420] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:16 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:16.763189 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8cf7b9be-d6de-4880-b823-c6f5e307b885 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:16.764171 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8cf7b9be-d6de-4880-b823-c6f5e307b885 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:16.770440 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8cf7b9be-d6de-4880-b823-c6f5e307b885 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:16.770880 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8cf7b9be-d6de-4880-b823-c6f5e307b885 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:16.772112 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8cf7b9be-d6de-4880-b823-c6f5e307b885 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:16.772574 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8cf7b9be-d6de-4880-b823-c6f5e307b885 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:16.823092 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8cf7b9be-d6de-4880-b823-c6f5e307b885 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070545 Aug 10 03:41:16.824052 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 211/421] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:41:16 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:41:16.833484 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1c0f388b-1d55-4c85-910b-5d0f743c5935 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:16.833484 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1c0f388b-1d55-4c85-910b-5d0f743c5935 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:16.837372 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1c0f388b-1d55-4c85-910b-5d0f743c5935 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:16.837832 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1c0f388b-1d55-4c85-910b-5d0f743c5935 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:16.838871 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1c0f388b-1d55-4c85-910b-5d0f743c5935 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:16.839355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1c0f388b-1d55-4c85-910b-5d0f743c5935 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:16.882838 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d56f59f4-e889-4a6e-aafb-358a127cdf3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:16.890700 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d56f59f4-e889-4a6e-aafb-358a127cdf3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.269017 Aug 10 03:41:16.891255 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 211/422] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:16 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:16.896816 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b0bf5e50-cc48-4dea-ae8c-345660ea3e61 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:16.897850 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b0bf5e50-cc48-4dea-ae8c-345660ea3e61 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:16.903729 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b0bf5e50-cc48-4dea-ae8c-345660ea3e61 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:16.904177 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b0bf5e50-cc48-4dea-ae8c-345660ea3e61 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:16.905017 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b0bf5e50-cc48-4dea-ae8c-345660ea3e61 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:16.905914 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b0bf5e50-cc48-4dea-ae8c-345660ea3e61 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:16.908007 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1c0f388b-1d55-4c85-910b-5d0f743c5935 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:16.916007 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1c0f388b-1d55-4c85-910b-5d0f743c5935 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1272 microversion: 2.1 time: 0.090670 Aug 10 03:41:16.916727 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 212/423] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:16 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:16.928839 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e78a34bb-22d4-4db0-9468-192cda211b0a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:16.929916 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e78a34bb-22d4-4db0-9468-192cda211b0a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:16.937574 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e78a34bb-22d4-4db0-9468-192cda211b0a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:16.938148 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e78a34bb-22d4-4db0-9468-192cda211b0a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:16.938991 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e78a34bb-22d4-4db0-9468-192cda211b0a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:16.939664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e78a34bb-22d4-4db0-9468-192cda211b0a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:16.965349 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-e78a34bb-22d4-4db0-9468-192cda211b0a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lazy-loading 'flavor' on Instance uuid 0c599984-f271-4886-be2f-73e7531f52e4 {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:41:17.072966 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b0bf5e50-cc48-4dea-ae8c-345660ea3e61 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 200 len: 38204 microversion: 2.1 time: 0.179499 Aug 10 03:41:17.074495 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 212/424] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:16 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 38204 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:41:17.085208 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b10f06d1-d8b2-4bd5-b422-fd131c22ad02 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:17.085781 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b10f06d1-d8b2-4bd5-b422-fd131c22ad02 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:17.093386 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b10f06d1-d8b2-4bd5-b422-fd131c22ad02 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:17.103113 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b10f06d1-d8b2-4bd5-b422-fd131c22ad02 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:17.103113 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b10f06d1-d8b2-4bd5-b422-fd131c22ad02 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:17.103113 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b10f06d1-d8b2-4bd5-b422-fd131c22ad02 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:17.120412 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b10f06d1-d8b2-4bd5-b422-fd131c22ad02 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/ips" status: 200 len: 146 microversion: 2.1 time: 0.039780 Aug 10 03:41:17.120988 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 213/425] 10.222.0.21 () {58 vars in 1248 bytes} [Tue Aug 10 03:41:17 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:41:17.768907 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-034af10f-905b-42c2-8a73-557c8c824ff7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:17.769545 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-034af10f-905b-42c2-8a73-557c8c824ff7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:17.775541 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-034af10f-905b-42c2-8a73-557c8c824ff7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:17.775985 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-034af10f-905b-42c2-8a73-557c8c824ff7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:17.776963 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-034af10f-905b-42c2-8a73-557c8c824ff7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:17.777389 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-034af10f-905b-42c2-8a73-557c8c824ff7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:17.899386 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-034af10f-905b-42c2-8a73-557c8c824ff7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:17.907913 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-034af10f-905b-42c2-8a73-557c8c824ff7 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1429 microversion: 2.1 time: 0.143266 Aug 10 03:41:17.910584 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 214/426] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:17 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1429 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:17.919382 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e78a34bb-22d4-4db0-9468-192cda211b0a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 202 len: 0 microversion: 2.20 time: 0.995640 Aug 10 03:41:17.919382 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 213/427] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:41:16 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 0 bytes in 1002 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:41:17.927543 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-bc0d8772-cea6-4e92-aca7-153bc3b3eba6 req-de65e044-0f9b-43ed-b203-3edc59e0bc6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b2ff6d-182a-4e59-8e35-c72521e5a321", "name": "network-vif-deleted", "tag": "728523d7-369a-49a2-937d-b2808fcdcf0c"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:17.929698 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:41:17.929698 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:41:17.930391 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1a3546ac-bd3b-4f37-a156-f686d96b40f7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:17.932617 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1a3546ac-bd3b-4f37-a156-f686d96b40f7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:17.941826 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-bc0d8772-cea6-4e92-aca7-153bc3b3eba6 req-de65e044-0f9b-43ed-b203-3edc59e0bc6a service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:17.953061 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1a3546ac-bd3b-4f37-a156-f686d96b40f7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:17.953445 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-bc0d8772-cea6-4e92-aca7-153bc3b3eba6 req-de65e044-0f9b-43ed-b203-3edc59e0bc6a service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:17.953539 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1a3546ac-bd3b-4f37-a156-f686d96b40f7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:17.953539 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1a3546ac-bd3b-4f37-a156-f686d96b40f7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:17.953539 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1a3546ac-bd3b-4f37-a156-f686d96b40f7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:17.959476 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-bc0d8772-cea6-4e92-aca7-153bc3b3eba6 req-de65e044-0f9b-43ed-b203-3edc59e0bc6a service nova] Creating event network-vif-deleted:728523d7-369a-49a2-937d-b2808fcdcf0c for instance d2b2ff6d-182a-4e59-8e35-c72521e5a321 on hv-cinder-78239 Aug 10 03:41:17.965172 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-bc0d8772-cea6-4e92-aca7-153bc3b3eba6 req-de65e044-0f9b-43ed-b203-3edc59e0bc6a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043610 Aug 10 03:41:17.966385 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 214/428] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:41:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:41:17.974375 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-7b444a9b-ca0f-4277-ae49-6ac576fc91b8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:17.975234 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-7b444a9b-ca0f-4277-ae49-6ac576fc91b8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:17.985698 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7b444a9b-ca0f-4277-ae49-6ac576fc91b8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:17.986203 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7b444a9b-ca0f-4277-ae49-6ac576fc91b8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:17.987028 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7b444a9b-ca0f-4277-ae49-6ac576fc91b8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:17.987836 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7b444a9b-ca0f-4277-ae49-6ac576fc91b8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:18.005046 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1a3546ac-bd3b-4f37-a156-f686d96b40f7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083727 Aug 10 03:41:18.005960 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 215/429] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:41:17 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:41:18.011303 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3f3b086e-e2dc-4970-98d4-a5c213d99513 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:18.012077 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3f3b086e-e2dc-4970-98d4-a5c213d99513 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:18.019177 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3f3b086e-e2dc-4970-98d4-a5c213d99513 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:18.019793 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3f3b086e-e2dc-4970-98d4-a5c213d99513 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:18.020541 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3f3b086e-e2dc-4970-98d4-a5c213d99513 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:18.021059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3f3b086e-e2dc-4970-98d4-a5c213d99513 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:18.151815 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-7b444a9b-ca0f-4277-ae49-6ac576fc91b8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:18.159933 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-7b444a9b-ca0f-4277-ae49-6ac576fc91b8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.192264 Aug 10 03:41:18.160586 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 215/430] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:17 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:18.172140 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3a3f7d8c-8b51-48b1-9602-bb241fe80ad6 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:18.172963 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3a3f7d8c-8b51-48b1-9602-bb241fe80ad6 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:18.179033 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a3f7d8c-8b51-48b1-9602-bb241fe80ad6 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:18.179622 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a3f7d8c-8b51-48b1-9602-bb241fe80ad6 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:18.180644 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a3f7d8c-8b51-48b1-9602-bb241fe80ad6 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:18.181571 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a3f7d8c-8b51-48b1-9602-bb241fe80ad6 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:18.189820 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3f3b086e-e2dc-4970-98d4-a5c213d99513 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:18.198797 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3f3b086e-e2dc-4970-98d4-a5c213d99513 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:18.200699 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3f3b086e-e2dc-4970-98d4-a5c213d99513 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:18.203309 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3f3b086e-e2dc-4970-98d4-a5c213d99513 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.195648 Aug 10 03:41:18.204649 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 216/431] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:18 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:18.213814 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1280340649", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452", "networks": [{"uuid": "05518596-49b6-4e96-8053-0b4e84949d5e"}]}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:18.269912 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.network.neutron [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] validate_networks() for [('05518596-49b6-4e96-8053-0b4e84949d5e', None, None, None)] {{(pid=108440) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:41:18.314796 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3a3f7d8c-8b51-48b1-9602-bb241fe80ad6 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:18.322136 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3a3f7d8c-8b51-48b1-9602-bb241fe80ad6 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1312 microversion: 2.1 time: 0.160605 Aug 10 03:41:18.322698 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 216/432] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:18 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:18.869396 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Flavor limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:41:18.869892 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Image limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:41:18.870260 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Flavor pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:41:18.870660 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Image pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:41:18.871537 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:41:18.881542 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:18.881987 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:18.882785 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:18.883267 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:18.900836 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Getting quotas for project 0218bd23bab4457abfb072f168e61af6. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:41:18.909391 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Getting quotas for user cb4a0eaef1ba4df5a07bda5bef95dd99 and project 0218bd23bab4457abfb072f168e61af6. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:41:18.917005 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Going to run 1 instances... {{(pid=108440) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:41:18.919339 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:41:18.927043 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-fbf8ed5b-4f98-419d-8d09-45da16e6786e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:18.927846 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-fbf8ed5b-4f98-419d-8d09-45da16e6786e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:18.934689 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbf8ed5b-4f98-419d-8d09-45da16e6786e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:18.935190 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbf8ed5b-4f98-419d-8d09-45da16e6786e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:18.936145 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbf8ed5b-4f98-419d-8d09-45da16e6786e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:18.936617 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbf8ed5b-4f98-419d-8d09-45da16e6786e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:18.978252 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbf8ed5b-4f98-419d-8d09-45da16e6786e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:18.978252 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbf8ed5b-4f98-419d-8d09-45da16e6786e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:18.978252 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-fbf8ed5b-4f98-419d-8d09-45da16e6786e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lazy-loading 'fault' on Instance uuid d2b2ff6d-182a-4e59-8e35-c72521e5a321 {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:41:19.035327 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-fbf8ed5b-4f98-419d-8d09-45da16e6786e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20e4d4713d492cbf99cc584bf0446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f912b62093449cea652d5e2b536ac2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:19.043486 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-fbf8ed5b-4f98-419d-8d09-45da16e6786e tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 200 len: 1305 microversion: 2.1 time: 0.120591 Aug 10 03:41:19.044162 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 217/433] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:18 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 1305 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:19.149399 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-471e2d88-c369-4bc6-9038-cffafb685403 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938637 Aug 10 03:41:19.150341 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 217/434] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:41:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 03:41:19.162778 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e24d2ea0-27a2-491e-9d42-9d0b8e84dbe5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:19.163390 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e24d2ea0-27a2-491e-9d42-9d0b8e84dbe5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:19.177372 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f6f5b4c3-6458-4edb-8d3f-b7370dd0aadf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:19.178142 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f6f5b4c3-6458-4edb-8d3f-b7370dd0aadf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:19.193342 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6f5b4c3-6458-4edb-8d3f-b7370dd0aadf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:19.211054 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6f5b4c3-6458-4edb-8d3f-b7370dd0aadf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:19.211054 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6f5b4c3-6458-4edb-8d3f-b7370dd0aadf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:19.211054 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f6f5b4c3-6458-4edb-8d3f-b7370dd0aadf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:19.241218 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e24d2ea0-27a2-491e-9d42-9d0b8e84dbe5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:19.250153 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e24d2ea0-27a2-491e-9d42-9d0b8e84dbe5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1218 microversion: 2.1 time: 0.090481 Aug 10 03:41:19.252566 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 218/435] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:19 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:19.266397 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5d8b9c96-0ff0-4228-8b03-581eefef61ba tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:19.267014 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-5d8b9c96-0ff0-4228-8b03-581eefef61ba tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:19.274938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5d8b9c96-0ff0-4228-8b03-581eefef61ba tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:19.274938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5d8b9c96-0ff0-4228-8b03-581eefef61ba tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:19.274938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5d8b9c96-0ff0-4228-8b03-581eefef61ba tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:19.274938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5d8b9c96-0ff0-4228-8b03-581eefef61ba tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:19.366454 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f6f5b4c3-6458-4edb-8d3f-b7370dd0aadf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:19.390751 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f6f5b4c3-6458-4edb-8d3f-b7370dd0aadf tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.217146 Aug 10 03:41:19.396697 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 218/436] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:19 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:19.403847 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0725e88b-7a61-4255-be57-4bdd53f0e9c4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:19.404711 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0725e88b-7a61-4255-be57-4bdd53f0e9c4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:19.415804 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0725e88b-7a61-4255-be57-4bdd53f0e9c4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:19.416626 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0725e88b-7a61-4255-be57-4bdd53f0e9c4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:19.417717 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0725e88b-7a61-4255-be57-4bdd53f0e9c4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:19.418300 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0725e88b-7a61-4255-be57-4bdd53f0e9c4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:19.427741 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-5d8b9c96-0ff0-4228-8b03-581eefef61ba tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:19.435194 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-5d8b9c96-0ff0-4228-8b03-581eefef61ba tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:19.453138 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-5d8b9c96-0ff0-4228-8b03-581eefef61ba tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:19.453138 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5d8b9c96-0ff0-4228-8b03-581eefef61ba tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.176035 Aug 10 03:41:19.453138 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 219/437] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:19 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:19.576411 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0725e88b-7a61-4255-be57-4bdd53f0e9c4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:19.583906 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0725e88b-7a61-4255-be57-4bdd53f0e9c4 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1312 microversion: 2.1 time: 0.185954 Aug 10 03:41:19.589643 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 219/438] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:19 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:19.992215 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-7a1a5d6c-bfb4-4f40-99b5-34827c5f7522 req-85655e95-6f6a-4afc-8897-0c8c4784fb9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6705722e-734f-44c2-b853-04ee58f5202d", "tag": "befb1ced-df13-4ccc-9c87-fbef92863959"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:19.994194 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:41:19.994194 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:41:20.001811 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-7a1a5d6c-bfb4-4f40-99b5-34827c5f7522 req-85655e95-6f6a-4afc-8897-0c8c4784fb9f service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:20.002258 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-7a1a5d6c-bfb4-4f40-99b5-34827c5f7522 req-85655e95-6f6a-4afc-8897-0c8c4784fb9f service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:20.014448 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-7a1a5d6c-bfb4-4f40-99b5-34827c5f7522 req-85655e95-6f6a-4afc-8897-0c8c4784fb9f service nova] Creating event network-changed:befb1ced-df13-4ccc-9c87-fbef92863959 for instance 6705722e-734f-44c2-b853-04ee58f5202d on hv-cinder-78239 Aug 10 03:41:20.019705 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-7a1a5d6c-bfb4-4f40-99b5-34827c5f7522 req-85655e95-6f6a-4afc-8897-0c8c4784fb9f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031269 Aug 10 03:41:20.020517 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 220/439] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:41:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:41:20.065524 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1fe3f7ce-1941-402d-ab5e-91d528593379 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:20.066162 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1fe3f7ce-1941-402d-ab5e-91d528593379 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] [instance: d2b2ff6d-182a-4e59-8e35-c72521e5a321] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:20.072980 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1fe3f7ce-1941-402d-ab5e-91d528593379 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:20.073423 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1fe3f7ce-1941-402d-ab5e-91d528593379 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:20.074209 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1fe3f7ce-1941-402d-ab5e-91d528593379 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:20.074638 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1fe3f7ce-1941-402d-ab5e-91d528593379 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:20.102000 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-1fe3f7ce-1941-402d-ab5e-91d528593379 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] HTTP exception thrown: Instance d2b2ff6d-182a-4e59-8e35-c72521e5a321 could not be found. Aug 10 03:41:20.102685 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1fe3f7ce-1941-402d-ab5e-91d528593379 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] Returning 404 to user: Instance d2b2ff6d-182a-4e59-8e35-c72521e5a321 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:41:20.103526 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1fe3f7ce-1941-402d-ab5e-91d528593379 tempest-VolumesNegativeTest-302883610 tempest-VolumesNegativeTest-302883610-project] 10.222.0.21 "GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321" status: 404 len: 111 microversion: 2.1 time: 0.042196 Aug 10 03:41:20.104094 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 220/440] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:20 2021] GET /compute/v2.1/servers/d2b2ff6d-182a-4e59-8e35-c72521e5a321 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:41:20.270321 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2ae48c45-00d3-4498-af96-4f686577ced9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:20.280687 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2ae48c45-00d3-4498-af96-4f686577ced9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:20.352136 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2ae48c45-00d3-4498-af96-4f686577ced9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:20.359341 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2ae48c45-00d3-4498-af96-4f686577ced9 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1218 microversion: 2.1 time: 0.093545 Aug 10 03:41:20.359990 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 221/441] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:20 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:20.410806 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-73c1488e-a4dd-4d04-b639-5a32b86bc8a6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:20.411691 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-73c1488e-a4dd-4d04-b639-5a32b86bc8a6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:20.417770 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-73c1488e-a4dd-4d04-b639-5a32b86bc8a6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:20.418341 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-73c1488e-a4dd-4d04-b639-5a32b86bc8a6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:20.419213 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-73c1488e-a4dd-4d04-b639-5a32b86bc8a6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:20.419996 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-73c1488e-a4dd-4d04-b639-5a32b86bc8a6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:20.469871 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-66e78108-919a-4cd8-b4dc-449d0a48aa22 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:20.470488 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-66e78108-919a-4cd8-b4dc-449d0a48aa22 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:20.476591 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-66e78108-919a-4cd8-b4dc-449d0a48aa22 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:20.477031 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-66e78108-919a-4cd8-b4dc-449d0a48aa22 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:20.477805 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-66e78108-919a-4cd8-b4dc-449d0a48aa22 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:20.478287 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-66e78108-919a-4cd8-b4dc-449d0a48aa22 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:20.628110 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-66e78108-919a-4cd8-b4dc-449d0a48aa22 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:20.638280 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-66e78108-919a-4cd8-b4dc-449d0a48aa22 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:20.640520 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-66e78108-919a-4cd8-b4dc-449d0a48aa22 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:20.641881 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-66e78108-919a-4cd8-b4dc-449d0a48aa22 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.176371 Aug 10 03:41:20.644530 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 222/442] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:20 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:41:20.648357 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1634d398-ed09-4f58-992f-3bf6a4dfceff tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:20.649313 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1634d398-ed09-4f58-992f-3bf6a4dfceff tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:20.657443 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1634d398-ed09-4f58-992f-3bf6a4dfceff tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:20.657966 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1634d398-ed09-4f58-992f-3bf6a4dfceff tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:20.658842 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1634d398-ed09-4f58-992f-3bf6a4dfceff tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:20.659371 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1634d398-ed09-4f58-992f-3bf6a4dfceff tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:20.714066 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-73c1488e-a4dd-4d04-b639-5a32b86bc8a6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:20.724438 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-73c1488e-a4dd-4d04-b639-5a32b86bc8a6 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.316995 Aug 10 03:41:20.725612 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 221/443] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:20 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:20.793377 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1634d398-ed09-4f58-992f-3bf6a4dfceff tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:20.805495 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1634d398-ed09-4f58-992f-3bf6a4dfceff tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1312 microversion: 2.1 time: 0.160545 Aug 10 03:41:20.806099 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 223/444] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:20 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:21.375850 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-bb2a3996-c47e-450e-bf1e-54c0e1e85731 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:21.376488 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-bb2a3996-c47e-450e-bf1e-54c0e1e85731 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:21.382853 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bb2a3996-c47e-450e-bf1e-54c0e1e85731 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:21.383326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bb2a3996-c47e-450e-bf1e-54c0e1e85731 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:21.384130 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bb2a3996-c47e-450e-bf1e-54c0e1e85731 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:21.384587 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bb2a3996-c47e-450e-bf1e-54c0e1e85731 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:21.443380 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-bb2a3996-c47e-450e-bf1e-54c0e1e85731 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:21.450768 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-bb2a3996-c47e-450e-bf1e-54c0e1e85731 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1222 microversion: 2.1 time: 0.078583 Aug 10 03:41:21.451325 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 222/445] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:21 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:21.669273 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2d759573-3e25-4b5a-ad7a-264fc5b6ae90 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:21.670085 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2d759573-3e25-4b5a-ad7a-264fc5b6ae90 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:21.676425 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2d759573-3e25-4b5a-ad7a-264fc5b6ae90 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:21.676866 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2d759573-3e25-4b5a-ad7a-264fc5b6ae90 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:21.677652 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2d759573-3e25-4b5a-ad7a-264fc5b6ae90 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:21.678089 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2d759573-3e25-4b5a-ad7a-264fc5b6ae90 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:21.742776 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3e4afa0b-63f3-42aa-bf70-fcc3352bb1db tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:21.743389 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3e4afa0b-63f3-42aa-bf70-fcc3352bb1db tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:21.749213 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3e4afa0b-63f3-42aa-bf70-fcc3352bb1db tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:21.750163 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3e4afa0b-63f3-42aa-bf70-fcc3352bb1db tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:21.750972 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3e4afa0b-63f3-42aa-bf70-fcc3352bb1db tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:21.751403 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3e4afa0b-63f3-42aa-bf70-fcc3352bb1db tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:21.799434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2d759573-3e25-4b5a-ad7a-264fc5b6ae90 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:21.807238 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2d759573-3e25-4b5a-ad7a-264fc5b6ae90 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:21.808855 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2d759573-3e25-4b5a-ad7a-264fc5b6ae90 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:21.810117 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2d759573-3e25-4b5a-ad7a-264fc5b6ae90 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.144846 Aug 10 03:41:21.810897 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 224/446] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:21 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:21.822275 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d4ee9d43-4304-44c4-8340-06b7aea14803 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:21.822887 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d4ee9d43-4304-44c4-8340-06b7aea14803 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:21.828709 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d4ee9d43-4304-44c4-8340-06b7aea14803 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:21.829161 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d4ee9d43-4304-44c4-8340-06b7aea14803 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:21.829924 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d4ee9d43-4304-44c4-8340-06b7aea14803 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:21.830356 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d4ee9d43-4304-44c4-8340-06b7aea14803 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:21.890535 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3e4afa0b-63f3-42aa-bf70-fcc3352bb1db tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:21.898577 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3e4afa0b-63f3-42aa-bf70-fcc3352bb1db tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.160370 Aug 10 03:41:21.906803 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 223/447] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:21 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:21.958987 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d4ee9d43-4304-44c4-8340-06b7aea14803 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:21.966256 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d4ee9d43-4304-44c4-8340-06b7aea14803 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1312 microversion: 2.1 time: 0.147480 Aug 10 03:41:21.966819 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 225/448] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:21 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1312 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:22.467702 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-27770dae-97c4-4d5f-9663-c8968804bb9b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:22.468401 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-27770dae-97c4-4d5f-9663-c8968804bb9b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:22.474352 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-27770dae-97c4-4d5f-9663-c8968804bb9b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:22.474806 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-27770dae-97c4-4d5f-9663-c8968804bb9b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:22.475582 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-27770dae-97c4-4d5f-9663-c8968804bb9b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:22.476016 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-27770dae-97c4-4d5f-9663-c8968804bb9b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:22.534678 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-27770dae-97c4-4d5f-9663-c8968804bb9b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:22.541775 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-27770dae-97c4-4d5f-9663-c8968804bb9b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1222 microversion: 2.1 time: 0.077790 Aug 10 03:41:22.542322 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 224/449] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:22 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:22.829782 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-218a5e67-12c6-4825-ac36-2e2e03ce1d14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:22.830387 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-218a5e67-12c6-4825-ac36-2e2e03ce1d14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:22.836851 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-218a5e67-12c6-4825-ac36-2e2e03ce1d14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:22.837301 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-218a5e67-12c6-4825-ac36-2e2e03ce1d14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:22.838174 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-218a5e67-12c6-4825-ac36-2e2e03ce1d14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:22.838611 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-218a5e67-12c6-4825-ac36-2e2e03ce1d14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:22.921869 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b4c9a5ce-33cc-455f-ad87-f3c91942e5dd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:22.922482 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b4c9a5ce-33cc-455f-ad87-f3c91942e5dd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:22.928373 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b4c9a5ce-33cc-455f-ad87-f3c91942e5dd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:22.928819 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b4c9a5ce-33cc-455f-ad87-f3c91942e5dd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:22.929593 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b4c9a5ce-33cc-455f-ad87-f3c91942e5dd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:22.930031 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b4c9a5ce-33cc-455f-ad87-f3c91942e5dd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:22.966446 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-218a5e67-12c6-4825-ac36-2e2e03ce1d14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:22.979774 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-218a5e67-12c6-4825-ac36-2e2e03ce1d14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:22.981428 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-218a5e67-12c6-4825-ac36-2e2e03ce1d14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:22.982575 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-218a5e67-12c6-4825-ac36-2e2e03ce1d14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.157125 Aug 10 03:41:22.983290 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 226/450] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:22 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:22.987695 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-39dc5216-615b-4ea1-b453-aceb38197a98 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:22.988319 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-39dc5216-615b-4ea1-b453-aceb38197a98 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:22.994211 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-39dc5216-615b-4ea1-b453-aceb38197a98 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:22.994660 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-39dc5216-615b-4ea1-b453-aceb38197a98 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:22.999714 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-39dc5216-615b-4ea1-b453-aceb38197a98 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:22.999714 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-39dc5216-615b-4ea1-b453-aceb38197a98 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:23.056219 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b4c9a5ce-33cc-455f-ad87-f3c91942e5dd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:23.064567 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b4c9a5ce-33cc-455f-ad87-f3c91942e5dd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.146486 Aug 10 03:41:23.065207 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 225/451] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:22 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:23.123342 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-39dc5216-615b-4ea1-b453-aceb38197a98 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:23.131335 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-39dc5216-615b-4ea1-b453-aceb38197a98 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1312 microversion: 2.1 time: 0.147115 Aug 10 03:41:23.131997 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 227/452] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:22 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:23.558928 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-10557c59-fb53-4a71-b7c2-da4d631c43d3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:23.559579 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-10557c59-fb53-4a71-b7c2-da4d631c43d3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:23.565481 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-10557c59-fb53-4a71-b7c2-da4d631c43d3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:23.565927 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-10557c59-fb53-4a71-b7c2-da4d631c43d3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:23.566717 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-10557c59-fb53-4a71-b7c2-da4d631c43d3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:23.567153 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-10557c59-fb53-4a71-b7c2-da4d631c43d3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:23.628004 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-10557c59-fb53-4a71-b7c2-da4d631c43d3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:23.635237 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-10557c59-fb53-4a71-b7c2-da4d631c43d3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1222 microversion: 2.1 time: 0.080149 Aug 10 03:41:23.635791 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 226/453] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:23 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:24.001149 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-89742e13-cfcf-4fcc-ae16-894a8ad90ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:24.001751 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-89742e13-cfcf-4fcc-ae16-894a8ad90ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:24.007675 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-89742e13-cfcf-4fcc-ae16-894a8ad90ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:24.008120 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-89742e13-cfcf-4fcc-ae16-894a8ad90ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:24.008924 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-89742e13-cfcf-4fcc-ae16-894a8ad90ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:24.009348 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-89742e13-cfcf-4fcc-ae16-894a8ad90ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:24.082732 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3562ec47-0f96-4c49-a890-aafaed57eb3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:24.083390 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3562ec47-0f96-4c49-a890-aafaed57eb3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:24.089867 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3562ec47-0f96-4c49-a890-aafaed57eb3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:24.090298 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3562ec47-0f96-4c49-a890-aafaed57eb3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:24.091399 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3562ec47-0f96-4c49-a890-aafaed57eb3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:24.091833 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3562ec47-0f96-4c49-a890-aafaed57eb3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:24.151153 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-89742e13-cfcf-4fcc-ae16-894a8ad90ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:24.159432 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-89742e13-cfcf-4fcc-ae16-894a8ad90ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:24.160945 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-89742e13-cfcf-4fcc-ae16-894a8ad90ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:24.162100 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-89742e13-cfcf-4fcc-ae16-894a8ad90ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.164839 Aug 10 03:41:24.162701 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 228/454] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:23 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:24.167452 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ff90e08b-7908-44b5-928a-5f4cc27af78d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:24.167944 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ff90e08b-7908-44b5-928a-5f4cc27af78d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:24.176558 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ff90e08b-7908-44b5-928a-5f4cc27af78d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:24.176963 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ff90e08b-7908-44b5-928a-5f4cc27af78d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:24.182819 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ff90e08b-7908-44b5-928a-5f4cc27af78d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:24.183613 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ff90e08b-7908-44b5-928a-5f4cc27af78d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:24.296500 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3562ec47-0f96-4c49-a890-aafaed57eb3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:24.304305 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3562ec47-0f96-4c49-a890-aafaed57eb3a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.226128 Aug 10 03:41:24.305047 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 227/455] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:24 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:24.334235 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ff90e08b-7908-44b5-928a-5f4cc27af78d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:24.348373 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ff90e08b-7908-44b5-928a-5f4cc27af78d tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1312 microversion: 2.1 time: 0.184433 Aug 10 03:41:24.349228 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 229/456] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:24 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:24.575925 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-5e40c320-0ea7-43f1-8b53-fa22ee00d509 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b61b8f92-1f16-4425-a3f6-32026f1f8a6a"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:24.577086 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-5e40c320-0ea7-43f1-8b53-fa22ee00d509 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:24.583875 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5e40c320-0ea7-43f1-8b53-fa22ee00d509 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:24.584579 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5e40c320-0ea7-43f1-8b53-fa22ee00d509 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:24.585553 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5e40c320-0ea7-43f1-8b53-fa22ee00d509 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:24.585990 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5e40c320-0ea7-43f1-8b53-fa22ee00d509 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:24.653626 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c15f7743-876c-4efb-ada6-8f19941980da tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:24.654621 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c15f7743-876c-4efb-ada6-8f19941980da tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:24.660982 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c15f7743-876c-4efb-ada6-8f19941980da tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:24.661432 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c15f7743-876c-4efb-ada6-8f19941980da tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:24.662408 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c15f7743-876c-4efb-ada6-8f19941980da tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:24.663043 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c15f7743-876c-4efb-ada6-8f19941980da tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:24.732092 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c15f7743-876c-4efb-ada6-8f19941980da tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:24.741266 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c15f7743-876c-4efb-ada6-8f19941980da tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1270 microversion: 2.1 time: 0.092854 Aug 10 03:41:24.748268 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 230/457] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:24 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:25.181199 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c6f2ebc4-f77b-419f-9b10-7f7ce4ada884 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:25.181837 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c6f2ebc4-f77b-419f-9b10-7f7ce4ada884 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:25.188021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c6f2ebc4-f77b-419f-9b10-7f7ce4ada884 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:25.188537 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c6f2ebc4-f77b-419f-9b10-7f7ce4ada884 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:25.189259 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c6f2ebc4-f77b-419f-9b10-7f7ce4ada884 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:25.189670 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c6f2ebc4-f77b-419f-9b10-7f7ce4ada884 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:25.322643 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c6f2ebc4-f77b-419f-9b10-7f7ce4ada884 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:25.331362 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c6f2ebc4-f77b-419f-9b10-7f7ce4ada884 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:25.333233 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c6f2ebc4-f77b-419f-9b10-7f7ce4ada884 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:25.334545 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c6f2ebc4-f77b-419f-9b10-7f7ce4ada884 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.157151 Aug 10 03:41:25.335244 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 231/458] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:25 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:41:25.354452 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6e2c9c33-81d3-40d2-a934-252a66bc2a9d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:25.363352 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6e2c9c33-81d3-40d2-a934-252a66bc2a9d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:25.363352 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6e2c9c33-81d3-40d2-a934-252a66bc2a9d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:25.363352 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6e2c9c33-81d3-40d2-a934-252a66bc2a9d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:25.364001 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6e2c9c33-81d3-40d2-a934-252a66bc2a9d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:25.364788 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6e2c9c33-81d3-40d2-a934-252a66bc2a9d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:25.507769 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6e2c9c33-81d3-40d2-a934-252a66bc2a9d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:25.515427 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6e2c9c33-81d3-40d2-a934-252a66bc2a9d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.165463 Aug 10 03:41:25.516458 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 232/459] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:25 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:25.520503 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a2444a1e-1018-41a1-82ac-82f50d7e3c35 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:25.521350 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a2444a1e-1018-41a1-82ac-82f50d7e3c35 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:25.534326 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a2444a1e-1018-41a1-82ac-82f50d7e3c35 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:25.534326 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a2444a1e-1018-41a1-82ac-82f50d7e3c35 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:25.534326 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a2444a1e-1018-41a1-82ac-82f50d7e3c35 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:25.534326 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a2444a1e-1018-41a1-82ac-82f50d7e3c35 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:25.687136 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a2444a1e-1018-41a1-82ac-82f50d7e3c35 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:25.696947 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a2444a1e-1018-41a1-82ac-82f50d7e3c35 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1312 microversion: 2.1 time: 0.179751 Aug 10 03:41:25.697911 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 233/460] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:25 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1312 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:25.758991 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a28b4b83-8733-4ba4-8234-08d777755725 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:25.759842 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a28b4b83-8733-4ba4-8234-08d777755725 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:25.766306 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a28b4b83-8733-4ba4-8234-08d777755725 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:25.766810 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a28b4b83-8733-4ba4-8234-08d777755725 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:25.767577 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a28b4b83-8733-4ba4-8234-08d777755725 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:25.768001 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a28b4b83-8733-4ba4-8234-08d777755725 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:25.828078 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a28b4b83-8733-4ba4-8234-08d777755725 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:25.835290 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a28b4b83-8733-4ba4-8234-08d777755725 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1278 microversion: 2.1 time: 0.080343 Aug 10 03:41:25.836370 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 234/461] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:25 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1278 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:26.342251 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-5e40c320-0ea7-43f1-8b53-fa22ee00d509 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.770165 Aug 10 03:41:26.342836 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 228/462] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 10 03:41:24 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/os-volume_attachments => generated 194 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:41:26.352763 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f053e7f9-a1b8-4987-b44f-27518723aafb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:26.354020 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f053e7f9-a1b8-4987-b44f-27518723aafb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:26.361032 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f053e7f9-a1b8-4987-b44f-27518723aafb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:26.361375 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f053e7f9-a1b8-4987-b44f-27518723aafb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:26.362141 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f053e7f9-a1b8-4987-b44f-27518723aafb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:26.362565 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f053e7f9-a1b8-4987-b44f-27518723aafb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:26.499414 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f053e7f9-a1b8-4987-b44f-27518723aafb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:26.508650 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f053e7f9-a1b8-4987-b44f-27518723aafb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:26.510351 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f053e7f9-a1b8-4987-b44f-27518723aafb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:26.512500 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f053e7f9-a1b8-4987-b44f-27518723aafb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.162641 Aug 10 03:41:26.513198 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 235/463] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:26 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:26.539449 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-9181fb9d-b08b-4fb5-9172-8ff12e037c1b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:26.540964 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-9181fb9d-b08b-4fb5-9172-8ff12e037c1b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:26.551906 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9181fb9d-b08b-4fb5-9172-8ff12e037c1b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:26.552543 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9181fb9d-b08b-4fb5-9172-8ff12e037c1b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:26.553466 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9181fb9d-b08b-4fb5-9172-8ff12e037c1b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:26.554031 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9181fb9d-b08b-4fb5-9172-8ff12e037c1b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:26.699314 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9181fb9d-b08b-4fb5-9172-8ff12e037c1b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:26.707093 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-9181fb9d-b08b-4fb5-9172-8ff12e037c1b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.175394 Aug 10 03:41:26.719107 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 229/464] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:26 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:26.719249 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b38315e9-b64c-4133-9fd1-c09a7f7b0909 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:26.719249 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b38315e9-b64c-4133-9fd1-c09a7f7b0909 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:26.724786 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b38315e9-b64c-4133-9fd1-c09a7f7b0909 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:26.725229 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b38315e9-b64c-4133-9fd1-c09a7f7b0909 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:26.725991 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b38315e9-b64c-4133-9fd1-c09a7f7b0909 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:26.726417 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b38315e9-b64c-4133-9fd1-c09a7f7b0909 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:26.849284 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b38315e9-b64c-4133-9fd1-c09a7f7b0909 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:26.852363 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3e2bbfb8-d51e-475e-97a3-2fa9f22adff8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:26.853076 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3e2bbfb8-d51e-475e-97a3-2fa9f22adff8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:26.857031 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b38315e9-b64c-4133-9fd1-c09a7f7b0909 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1312 microversion: 2.1 time: 0.143643 Aug 10 03:41:26.857675 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 236/465] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:26 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1312 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:26.859741 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3e2bbfb8-d51e-475e-97a3-2fa9f22adff8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:26.860504 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3e2bbfb8-d51e-475e-97a3-2fa9f22adff8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:26.861321 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3e2bbfb8-d51e-475e-97a3-2fa9f22adff8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:26.861746 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3e2bbfb8-d51e-475e-97a3-2fa9f22adff8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:26.987238 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3e2bbfb8-d51e-475e-97a3-2fa9f22adff8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:26.994517 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3e2bbfb8-d51e-475e-97a3-2fa9f22adff8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1318 microversion: 2.1 time: 0.146042 Aug 10 03:41:26.996008 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 230/466] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:26 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:27.532613 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b12d8d36-82b8-4d3e-9e73-5801d89a76d8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:27.533249 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b12d8d36-82b8-4d3e-9e73-5801d89a76d8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:27.539096 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b12d8d36-82b8-4d3e-9e73-5801d89a76d8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:27.539533 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b12d8d36-82b8-4d3e-9e73-5801d89a76d8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:27.540320 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b12d8d36-82b8-4d3e-9e73-5801d89a76d8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:27.540754 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b12d8d36-82b8-4d3e-9e73-5801d89a76d8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:27.662288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b12d8d36-82b8-4d3e-9e73-5801d89a76d8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:27.670033 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b12d8d36-82b8-4d3e-9e73-5801d89a76d8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:27.672021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b12d8d36-82b8-4d3e-9e73-5801d89a76d8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:27.673192 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b12d8d36-82b8-4d3e-9e73-5801d89a76d8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.144216 Aug 10 03:41:27.673729 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 237/467] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:27 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:27.723841 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-af58e0b7-ed52-4c74-ae2f-dc0c1bccf099 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:27.724401 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-af58e0b7-ed52-4c74-ae2f-dc0c1bccf099 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:27.730478 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-af58e0b7-ed52-4c74-ae2f-dc0c1bccf099 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:27.730915 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-af58e0b7-ed52-4c74-ae2f-dc0c1bccf099 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:27.731684 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-af58e0b7-ed52-4c74-ae2f-dc0c1bccf099 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:27.732113 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-af58e0b7-ed52-4c74-ae2f-dc0c1bccf099 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:27.853475 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-af58e0b7-ed52-4c74-ae2f-dc0c1bccf099 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:27.861535 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-af58e0b7-ed52-4c74-ae2f-dc0c1bccf099 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.141438 Aug 10 03:41:27.862107 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 231/468] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:27 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:27.876390 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9dea7438-1f19-474d-81b7-21b138e16712 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:27.876989 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9dea7438-1f19-474d-81b7-21b138e16712 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:27.882996 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9dea7438-1f19-474d-81b7-21b138e16712 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:27.883436 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9dea7438-1f19-474d-81b7-21b138e16712 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:27.884225 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9dea7438-1f19-474d-81b7-21b138e16712 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:27.884668 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9dea7438-1f19-474d-81b7-21b138e16712 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:28.010187 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-9dea7438-1f19-474d-81b7-21b138e16712 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:28.013081 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d75de813-89fd-49b6-8477-84200d646072 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:28.014092 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d75de813-89fd-49b6-8477-84200d646072 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:28.020457 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d75de813-89fd-49b6-8477-84200d646072 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:28.020905 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d75de813-89fd-49b6-8477-84200d646072 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:28.021686 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d75de813-89fd-49b6-8477-84200d646072 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:28.022113 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d75de813-89fd-49b6-8477-84200d646072 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:28.023339 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9dea7438-1f19-474d-81b7-21b138e16712 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1312 microversion: 2.1 time: 0.151438 Aug 10 03:41:28.023908 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 238/469] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:27 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:28.149899 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d75de813-89fd-49b6-8477-84200d646072 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:28.157609 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d75de813-89fd-49b6-8477-84200d646072 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1318 microversion: 2.1 time: 0.149032 Aug 10 03:41:28.158167 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 232/470] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:28 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:28.690873 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-bdafc6fa-e334-456e-937a-dc0b72093d74 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:28.691468 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-bdafc6fa-e334-456e-937a-dc0b72093d74 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:28.697460 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bdafc6fa-e334-456e-937a-dc0b72093d74 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:28.697896 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bdafc6fa-e334-456e-937a-dc0b72093d74 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:28.698647 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bdafc6fa-e334-456e-937a-dc0b72093d74 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:28.699070 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bdafc6fa-e334-456e-937a-dc0b72093d74 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:28.817265 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bdafc6fa-e334-456e-937a-dc0b72093d74 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:28.824975 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bdafc6fa-e334-456e-937a-dc0b72093d74 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:28.826455 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bdafc6fa-e334-456e-937a-dc0b72093d74 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:28.828109 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-bdafc6fa-e334-456e-937a-dc0b72093d74 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.140881 Aug 10 03:41:28.828709 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 239/471] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:28 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:28.878359 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f8b9d1d8-cb2f-4922-a67a-444ce4a5e1a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:28.878965 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f8b9d1d8-cb2f-4922-a67a-444ce4a5e1a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:28.884745 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f8b9d1d8-cb2f-4922-a67a-444ce4a5e1a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:28.885184 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f8b9d1d8-cb2f-4922-a67a-444ce4a5e1a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:28.885940 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f8b9d1d8-cb2f-4922-a67a-444ce4a5e1a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:28.886375 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f8b9d1d8-cb2f-4922-a67a-444ce4a5e1a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:29.004012 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f8b9d1d8-cb2f-4922-a67a-444ce4a5e1a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:29.011582 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f8b9d1d8-cb2f-4922-a67a-444ce4a5e1a7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.137348 Aug 10 03:41:29.012134 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 233/472] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:28 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:29.040055 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-fee78fa5-8f7b-47c8-bb01-973063d001ab tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:29.040697 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-fee78fa5-8f7b-47c8-bb01-973063d001ab tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:29.046412 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fee78fa5-8f7b-47c8-bb01-973063d001ab tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:29.046863 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fee78fa5-8f7b-47c8-bb01-973063d001ab tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:29.047633 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fee78fa5-8f7b-47c8-bb01-973063d001ab tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:29.048068 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fee78fa5-8f7b-47c8-bb01-973063d001ab tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:29.165397 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-fee78fa5-8f7b-47c8-bb01-973063d001ab tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:29.173426 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-fee78fa5-8f7b-47c8-bb01-973063d001ab tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1312 microversion: 2.1 time: 0.136921 Aug 10 03:41:29.173974 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 240/473] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:29 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1312 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:29.174347 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d2dd0cd1-c0f4-4545-8450-d82ee8d58bb8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:29.174960 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d2dd0cd1-c0f4-4545-8450-d82ee8d58bb8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:29.180762 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d2dd0cd1-c0f4-4545-8450-d82ee8d58bb8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:29.181206 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d2dd0cd1-c0f4-4545-8450-d82ee8d58bb8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:29.181978 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d2dd0cd1-c0f4-4545-8450-d82ee8d58bb8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:29.182404 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d2dd0cd1-c0f4-4545-8450-d82ee8d58bb8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:29.302211 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d2dd0cd1-c0f4-4545-8450-d82ee8d58bb8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:29.309369 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d2dd0cd1-c0f4-4545-8450-d82ee8d58bb8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1318 microversion: 2.1 time: 0.139118 Aug 10 03:41:29.309913 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 234/474] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:29 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:29.847489 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d2739c0d-627a-4b19-8664-8aa4a2a3f20e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:29.848095 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d2739c0d-627a-4b19-8664-8aa4a2a3f20e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:29.854257 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d2739c0d-627a-4b19-8664-8aa4a2a3f20e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:29.854842 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d2739c0d-627a-4b19-8664-8aa4a2a3f20e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:29.855621 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d2739c0d-627a-4b19-8664-8aa4a2a3f20e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:29.856722 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d2739c0d-627a-4b19-8664-8aa4a2a3f20e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:29.996541 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d2739c0d-627a-4b19-8664-8aa4a2a3f20e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:30.004905 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d2739c0d-627a-4b19-8664-8aa4a2a3f20e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:30.006445 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d2739c0d-627a-4b19-8664-8aa4a2a3f20e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:30.007596 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d2739c0d-627a-4b19-8664-8aa4a2a3f20e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.164914 Aug 10 03:41:30.008161 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 241/475] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:29 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:30.029734 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-61c1ac7f-282b-4a31-80b9-f2829f6b6341 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:30.030438 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-61c1ac7f-282b-4a31-80b9-f2829f6b6341 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:30.036482 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-61c1ac7f-282b-4a31-80b9-f2829f6b6341 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:30.037344 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-61c1ac7f-282b-4a31-80b9-f2829f6b6341 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:30.037665 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-61c1ac7f-282b-4a31-80b9-f2829f6b6341 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:30.038091 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-61c1ac7f-282b-4a31-80b9-f2829f6b6341 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:30.190116 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6d93c743-92d2-4519-b96e-8d720228d0a0 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:30.190728 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6d93c743-92d2-4519-b96e-8d720228d0a0 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:30.196853 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6d93c743-92d2-4519-b96e-8d720228d0a0 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:30.197513 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6d93c743-92d2-4519-b96e-8d720228d0a0 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:30.198286 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6d93c743-92d2-4519-b96e-8d720228d0a0 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:30.198716 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6d93c743-92d2-4519-b96e-8d720228d0a0 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:30.231229 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-61c1ac7f-282b-4a31-80b9-f2829f6b6341 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:30.240768 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-61c1ac7f-282b-4a31-80b9-f2829f6b6341 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.215391 Aug 10 03:41:30.241336 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 235/476] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:30 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:30.246708 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-dba978ae-ea1f-4f82-8111-0c4807884692 req-f7805bbe-89a8-4bf6-9fcb-e024f5afcff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b772114c-6e12-41fc-b52a-f9bec5125afc", "tag": "089202fc-bf88-4e54-814b-80242a60ec09"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:30.248315 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:41:30.248315 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:41:30.269219 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-dba978ae-ea1f-4f82-8111-0c4807884692 req-f7805bbe-89a8-4bf6-9fcb-e024f5afcff0 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:30.269677 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-dba978ae-ea1f-4f82-8111-0c4807884692 req-f7805bbe-89a8-4bf6-9fcb-e024f5afcff0 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:30.281205 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-dba978ae-ea1f-4f82-8111-0c4807884692 req-f7805bbe-89a8-4bf6-9fcb-e024f5afcff0 service nova] Creating event network-changed:089202fc-bf88-4e54-814b-80242a60ec09 for instance b772114c-6e12-41fc-b52a-f9bec5125afc on hv-cinder-78239 Aug 10 03:41:30.285609 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-dba978ae-ea1f-4f82-8111-0c4807884692 req-f7805bbe-89a8-4bf6-9fcb-e024f5afcff0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043151 Aug 10 03:41:30.286383 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 236/477] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:41:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:41:30.329051 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c0a0b1e1-3761-4ace-b5f8-8a8361d91fe8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:30.329785 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c0a0b1e1-3761-4ace-b5f8-8a8361d91fe8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:30.331334 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6d93c743-92d2-4519-b96e-8d720228d0a0 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:30.339412 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6d93c743-92d2-4519-b96e-8d720228d0a0 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1312 microversion: 2.1 time: 0.153260 Aug 10 03:41:30.339747 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c0a0b1e1-3761-4ace-b5f8-8a8361d91fe8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:30.340220 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c0a0b1e1-3761-4ace-b5f8-8a8361d91fe8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:30.340855 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 242/478] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:30 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:30.345867 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c0a0b1e1-3761-4ace-b5f8-8a8361d91fe8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:30.345867 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c0a0b1e1-3761-4ace-b5f8-8a8361d91fe8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:30.530532 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c0a0b1e1-3761-4ace-b5f8-8a8361d91fe8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:30.537664 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c0a0b1e1-3761-4ace-b5f8-8a8361d91fe8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1318 microversion: 2.1 time: 0.214419 Aug 10 03:41:30.538476 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 237/479] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:30 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:31.026462 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-44836fa4-993d-4fce-8fb4-184f18417a1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:31.027094 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-44836fa4-993d-4fce-8fb4-184f18417a1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:31.036902 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-44836fa4-993d-4fce-8fb4-184f18417a1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:31.036902 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-44836fa4-993d-4fce-8fb4-184f18417a1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:31.036902 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-44836fa4-993d-4fce-8fb4-184f18417a1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:31.036902 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-44836fa4-993d-4fce-8fb4-184f18417a1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:31.162928 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-44836fa4-993d-4fce-8fb4-184f18417a1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:31.171618 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-44836fa4-993d-4fce-8fb4-184f18417a1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:31.173140 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-44836fa4-993d-4fce-8fb4-184f18417a1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:31.174385 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-44836fa4-993d-4fce-8fb4-184f18417a1e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.151685 Aug 10 03:41:31.175086 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 243/480] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:31 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:31.257542 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ad92e9f5-64e4-413f-ba93-c41f0ce6956f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:31.258158 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ad92e9f5-64e4-413f-ba93-c41f0ce6956f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:31.264047 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ad92e9f5-64e4-413f-ba93-c41f0ce6956f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:31.264531 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ad92e9f5-64e4-413f-ba93-c41f0ce6956f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:31.265297 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ad92e9f5-64e4-413f-ba93-c41f0ce6956f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:31.265727 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ad92e9f5-64e4-413f-ba93-c41f0ce6956f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:31.369905 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-167bc9cc-cb54-4902-8b3e-87901b08388f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:31.370809 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-167bc9cc-cb54-4902-8b3e-87901b08388f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:31.377320 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-167bc9cc-cb54-4902-8b3e-87901b08388f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:31.377792 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-167bc9cc-cb54-4902-8b3e-87901b08388f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:31.378749 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-167bc9cc-cb54-4902-8b3e-87901b08388f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:31.379173 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-167bc9cc-cb54-4902-8b3e-87901b08388f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:31.391222 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ad92e9f5-64e4-413f-ba93-c41f0ce6956f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:31.398655 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ad92e9f5-64e4-413f-ba93-c41f0ce6956f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1502 microversion: 2.1 time: 0.144812 Aug 10 03:41:31.399385 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 238/481] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:31 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1502 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:31.417047 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-baecd4ff-60d6-4d2c-9d6b-1f8fbff0ce37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d8a87e4-0ff0-4419-85e5-285d11c51461"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:31.418271 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-baecd4ff-60d6-4d2c-9d6b-1f8fbff0ce37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:31.424365 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-baecd4ff-60d6-4d2c-9d6b-1f8fbff0ce37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:31.425041 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-baecd4ff-60d6-4d2c-9d6b-1f8fbff0ce37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:31.425870 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-baecd4ff-60d6-4d2c-9d6b-1f8fbff0ce37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:31.426469 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-baecd4ff-60d6-4d2c-9d6b-1f8fbff0ce37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:31.451256 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-baecd4ff-60d6-4d2c-9d6b-1f8fbff0ce37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] HTTP exception thrown: Cannot 'attach_volume' instance f2c37d94-d078-4e35-819d-2ca11fc5cb5f while it is in vm_state rescued Aug 10 03:41:31.451953 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-baecd4ff-60d6-4d2c-9d6b-1f8fbff0ce37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Returning 409 to user: Cannot 'attach_volume' instance f2c37d94-d078-4e35-819d-2ca11fc5cb5f while it is in vm_state rescued {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:41:31.453396 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-baecd4ff-60d6-4d2c-9d6b-1f8fbff0ce37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "POST /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040514 Aug 10 03:41:31.453934 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 239/482] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 10 03:41:31 2021] POST /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 10 03:41:31.462703 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1646a207-5249-4cf2-b528-13273249fe37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:31.463350 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1646a207-5249-4cf2-b528-13273249fe37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:31.469290 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1646a207-5249-4cf2-b528-13273249fe37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:31.469732 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1646a207-5249-4cf2-b528-13273249fe37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:31.470500 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1646a207-5249-4cf2-b528-13273249fe37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:31.470930 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1646a207-5249-4cf2-b528-13273249fe37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:31.523303 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-167bc9cc-cb54-4902-8b3e-87901b08388f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:31.530548 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-167bc9cc-cb54-4902-8b3e-87901b08388f tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1312 microversion: 2.1 time: 0.167500 Aug 10 03:41:31.540118 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 244/483] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:31 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:31.554329 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ce220d01-bc8c-4b72-bedc-af46dfbf9abc tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:31.555054 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ce220d01-bc8c-4b72-bedc-af46dfbf9abc tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:31.561031 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce220d01-bc8c-4b72-bedc-af46dfbf9abc tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:31.562009 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce220d01-bc8c-4b72-bedc-af46dfbf9abc tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:31.562781 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce220d01-bc8c-4b72-bedc-af46dfbf9abc tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:31.563202 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce220d01-bc8c-4b72-bedc-af46dfbf9abc tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:31.686030 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ce220d01-bc8c-4b72-bedc-af46dfbf9abc tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:31.693740 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ce220d01-bc8c-4b72-bedc-af46dfbf9abc tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1318 microversion: 2.1 time: 0.143277 Aug 10 03:41:31.694291 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 245/484] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:31 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:31.700976 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-fd43f838-2a11-45bd-8ccb-94e75679b2de req-573d76db-f491-4ca9-a191-b30dd0415e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6705722e-734f-44c2-b853-04ee58f5202d", "name": "network-vif-plugged", "status": "completed", "tag": "befb1ced-df13-4ccc-9c87-fbef92863959"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:31.700976 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:41:31.700976 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:41:31.706750 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-fd43f838-2a11-45bd-8ccb-94e75679b2de req-573d76db-f491-4ca9-a191-b30dd0415e6b service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:31.707183 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-fd43f838-2a11-45bd-8ccb-94e75679b2de req-573d76db-f491-4ca9-a191-b30dd0415e6b service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:31.718184 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-fd43f838-2a11-45bd-8ccb-94e75679b2de req-573d76db-f491-4ca9-a191-b30dd0415e6b service nova] Creating event network-vif-plugged:befb1ced-df13-4ccc-9c87-fbef92863959 for instance 6705722e-734f-44c2-b853-04ee58f5202d on hv-cinder-78239 Aug 10 03:41:31.723049 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-fd43f838-2a11-45bd-8ccb-94e75679b2de req-573d76db-f491-4ca9-a191-b30dd0415e6b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027691 Aug 10 03:41:31.723620 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 246/485] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:41:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:41:31.889445 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1646a207-5249-4cf2-b528-13273249fe37 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "POST /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/action" status: 202 len: 0 microversion: 2.1 time: 0.430054 Aug 10 03:41:31.890842 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 240/486] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:31 2021] POST /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:41:31.899486 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8ca2b1be-bac9-4d14-a02a-b47ee4fb6273 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:31.900224 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8ca2b1be-bac9-4d14-a02a-b47ee4fb6273 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:31.906785 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ca2b1be-bac9-4d14-a02a-b47ee4fb6273 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:31.907250 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ca2b1be-bac9-4d14-a02a-b47ee4fb6273 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:31.908068 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ca2b1be-bac9-4d14-a02a-b47ee4fb6273 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:31.908529 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ca2b1be-bac9-4d14-a02a-b47ee4fb6273 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:32.030036 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8ca2b1be-bac9-4d14-a02a-b47ee4fb6273 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:32.037238 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8ca2b1be-bac9-4d14-a02a-b47ee4fb6273 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1510 microversion: 2.1 time: 0.141824 Aug 10 03:41:32.037929 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 247/487] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:31 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1510 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:32.194881 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-447cc599-15bd-4c83-a2ee-dbbec3b7653d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:32.195684 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-447cc599-15bd-4c83-a2ee-dbbec3b7653d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:32.202475 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-447cc599-15bd-4c83-a2ee-dbbec3b7653d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:32.203109 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-447cc599-15bd-4c83-a2ee-dbbec3b7653d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:32.204079 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-447cc599-15bd-4c83-a2ee-dbbec3b7653d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:32.213145 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-447cc599-15bd-4c83-a2ee-dbbec3b7653d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:32.396494 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-447cc599-15bd-4c83-a2ee-dbbec3b7653d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:32.404517 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-447cc599-15bd-4c83-a2ee-dbbec3b7653d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:32.406091 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-447cc599-15bd-4c83-a2ee-dbbec3b7653d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:32.407209 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-447cc599-15bd-4c83-a2ee-dbbec3b7653d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.218710 Aug 10 03:41:32.407755 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 241/488] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:32 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:32.548263 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c048429d-cf22-4397-a847-1c82dbacffa2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:32.548864 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c048429d-cf22-4397-a847-1c82dbacffa2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:32.556473 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c048429d-cf22-4397-a847-1c82dbacffa2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:32.556911 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c048429d-cf22-4397-a847-1c82dbacffa2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:32.557662 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c048429d-cf22-4397-a847-1c82dbacffa2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:32.558084 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c048429d-cf22-4397-a847-1c82dbacffa2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:32.696348 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c048429d-cf22-4397-a847-1c82dbacffa2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:32.703591 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c048429d-cf22-4397-a847-1c82dbacffa2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1312 microversion: 2.1 time: 0.160386 Aug 10 03:41:32.704404 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 248/489] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:32 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:32.710852 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-83530a63-72d9-48c1-8811-e85199fa4c32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:32.711704 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-83530a63-72d9-48c1-8811-e85199fa4c32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:32.718776 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-83530a63-72d9-48c1-8811-e85199fa4c32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:32.719222 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-83530a63-72d9-48c1-8811-e85199fa4c32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:32.720003 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-83530a63-72d9-48c1-8811-e85199fa4c32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:32.725578 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-83530a63-72d9-48c1-8811-e85199fa4c32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:33.057206 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-bc4bc8a8-c346-420a-9d7a-a3bdace705b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:33.060327 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-bc4bc8a8-c346-420a-9d7a-a3bdace705b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:33.071391 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bc4bc8a8-c346-420a-9d7a-a3bdace705b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:33.072359 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bc4bc8a8-c346-420a-9d7a-a3bdace705b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:33.080147 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bc4bc8a8-c346-420a-9d7a-a3bdace705b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:33.080147 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bc4bc8a8-c346-420a-9d7a-a3bdace705b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:33.207723 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-83530a63-72d9-48c1-8811-e85199fa4c32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:33.216974 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-83530a63-72d9-48c1-8811-e85199fa4c32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1318 microversion: 2.1 time: 0.509865 Aug 10 03:41:33.219722 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 242/490] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:32 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:33.279260 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bc4bc8a8-c346-420a-9d7a-a3bdace705b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:33.290427 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-bc4bc8a8-c346-420a-9d7a-a3bdace705b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1510 microversion: 2.1 time: 0.237424 Aug 10 03:41:33.291434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 249/491] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:33 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:33.426283 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-29f0e9bc-ee19-4970-a85a-a71a6dc65b57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:33.426990 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-29f0e9bc-ee19-4970-a85a-a71a6dc65b57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:33.433578 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-29f0e9bc-ee19-4970-a85a-a71a6dc65b57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:33.434064 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-29f0e9bc-ee19-4970-a85a-a71a6dc65b57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:33.434771 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-29f0e9bc-ee19-4970-a85a-a71a6dc65b57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:33.435202 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-29f0e9bc-ee19-4970-a85a-a71a6dc65b57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:33.578494 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-29f0e9bc-ee19-4970-a85a-a71a6dc65b57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:33.586435 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-29f0e9bc-ee19-4970-a85a-a71a6dc65b57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:33.587998 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-29f0e9bc-ee19-4970-a85a-a71a6dc65b57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:33.589378 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-29f0e9bc-ee19-4970-a85a-a71a6dc65b57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.166676 Aug 10 03:41:33.589709 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 243/492] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:33 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:33.726244 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f29bd9d8-8154-4990-83f6-517031d0ba1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:33.726942 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f29bd9d8-8154-4990-83f6-517031d0ba1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:33.733704 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f29bd9d8-8154-4990-83f6-517031d0ba1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:33.734263 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f29bd9d8-8154-4990-83f6-517031d0ba1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:33.735531 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f29bd9d8-8154-4990-83f6-517031d0ba1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:33.735969 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f29bd9d8-8154-4990-83f6-517031d0ba1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:33.872851 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f29bd9d8-8154-4990-83f6-517031d0ba1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:33.880686 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f29bd9d8-8154-4990-83f6-517031d0ba1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1312 microversion: 2.1 time: 0.158190 Aug 10 03:41:33.881256 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 250/493] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:33 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:34.236768 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-92d63ad8-06e7-4bc2-bb38-919897f31c31 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:34.240991 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-92d63ad8-06e7-4bc2-bb38-919897f31c31 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:34.244558 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-92d63ad8-06e7-4bc2-bb38-919897f31c31 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:34.244996 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-92d63ad8-06e7-4bc2-bb38-919897f31c31 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:34.245764 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-92d63ad8-06e7-4bc2-bb38-919897f31c31 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:34.246189 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-92d63ad8-06e7-4bc2-bb38-919897f31c31 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:34.306784 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-cd07b1d8-26e6-49bc-8194-e4877ada2512 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:34.307498 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-cd07b1d8-26e6-49bc-8194-e4877ada2512 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:34.314449 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cd07b1d8-26e6-49bc-8194-e4877ada2512 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:34.314905 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cd07b1d8-26e6-49bc-8194-e4877ada2512 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:34.315686 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cd07b1d8-26e6-49bc-8194-e4877ada2512 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:34.316117 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cd07b1d8-26e6-49bc-8194-e4877ada2512 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:34.428096 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-92d63ad8-06e7-4bc2-bb38-919897f31c31 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:34.436996 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-92d63ad8-06e7-4bc2-bb38-919897f31c31 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1318 microversion: 2.1 time: 0.204862 Aug 10 03:41:34.437811 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 244/494] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:34 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:34.447259 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-cd07b1d8-26e6-49bc-8194-e4877ada2512 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:34.454413 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-cd07b1d8-26e6-49bc-8194-e4877ada2512 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1510 microversion: 2.1 time: 0.151332 Aug 10 03:41:34.455022 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 251/495] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:34 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:34.606685 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1cb4d8de-9d12-4364-a36e-93ca34e92ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:34.608957 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1cb4d8de-9d12-4364-a36e-93ca34e92ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:34.613688 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1cb4d8de-9d12-4364-a36e-93ca34e92ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:34.614126 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1cb4d8de-9d12-4364-a36e-93ca34e92ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:34.614880 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1cb4d8de-9d12-4364-a36e-93ca34e92ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:34.615421 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1cb4d8de-9d12-4364-a36e-93ca34e92ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:34.736559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1cb4d8de-9d12-4364-a36e-93ca34e92ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:34.744378 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1cb4d8de-9d12-4364-a36e-93ca34e92ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:34.745957 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1cb4d8de-9d12-4364-a36e-93ca34e92ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:34.747274 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1cb4d8de-9d12-4364-a36e-93ca34e92ae6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.144257 Aug 10 03:41:34.747947 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 245/496] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:34 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:34.897110 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5972340b-dd8c-4036-a559-80475af19f5e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:34.897854 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-5972340b-dd8c-4036-a559-80475af19f5e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:34.903609 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5972340b-dd8c-4036-a559-80475af19f5e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:34.904053 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5972340b-dd8c-4036-a559-80475af19f5e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:34.904889 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5972340b-dd8c-4036-a559-80475af19f5e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:34.905330 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5972340b-dd8c-4036-a559-80475af19f5e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:35.025803 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-5972340b-dd8c-4036-a559-80475af19f5e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:35.033791 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5972340b-dd8c-4036-a559-80475af19f5e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1496 microversion: 2.1 time: 0.140388 Aug 10 03:41:35.034363 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 252/497] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:34 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1496 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:35.455349 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-cd7c474a-5f01-4faa-9a57-fba2ca987514 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:35.455958 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-cd7c474a-5f01-4faa-9a57-fba2ca987514 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:35.461748 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cd7c474a-5f01-4faa-9a57-fba2ca987514 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:35.462184 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cd7c474a-5f01-4faa-9a57-fba2ca987514 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:35.462943 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cd7c474a-5f01-4faa-9a57-fba2ca987514 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:35.463367 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cd7c474a-5f01-4faa-9a57-fba2ca987514 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:35.471531 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-464dacc8-afed-4223-b44e-92d26104d2b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:35.472408 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-464dacc8-afed-4223-b44e-92d26104d2b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:35.478364 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-464dacc8-afed-4223-b44e-92d26104d2b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:35.479125 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-464dacc8-afed-4223-b44e-92d26104d2b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:35.480313 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-464dacc8-afed-4223-b44e-92d26104d2b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:35.481183 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-464dacc8-afed-4223-b44e-92d26104d2b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:35.628659 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-464dacc8-afed-4223-b44e-92d26104d2b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:35.632482 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-cd7c474a-5f01-4faa-9a57-fba2ca987514 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:35.637270 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-464dacc8-afed-4223-b44e-92d26104d2b5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1510 microversion: 2.1 time: 0.169267 Aug 10 03:41:35.647258 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 253/498] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:35 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:35.647435 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-cd7c474a-5f01-4faa-9a57-fba2ca987514 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1318 microversion: 2.1 time: 0.189013 Aug 10 03:41:35.647435 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 246/499] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:35 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:35.765571 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-04a3b41b-5308-4221-915a-1afca1c00688 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:35.766185 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-04a3b41b-5308-4221-915a-1afca1c00688 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:35.784049 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-04a3b41b-5308-4221-915a-1afca1c00688 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:35.785706 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-04a3b41b-5308-4221-915a-1afca1c00688 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:35.787705 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-04a3b41b-5308-4221-915a-1afca1c00688 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:35.789241 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-04a3b41b-5308-4221-915a-1afca1c00688 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:35.947321 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-04a3b41b-5308-4221-915a-1afca1c00688 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:35.956495 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-04a3b41b-5308-4221-915a-1afca1c00688 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:35.958132 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-04a3b41b-5308-4221-915a-1afca1c00688 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:35.959278 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-04a3b41b-5308-4221-915a-1afca1c00688 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.197958 Aug 10 03:41:35.959837 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 254/500] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:35 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:36.448983 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1d6a4d40-f3f2-4c60-9377-98ba650892c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:36.449581 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1d6a4d40-f3f2-4c60-9377-98ba650892c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:36.455232 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1d6a4d40-f3f2-4c60-9377-98ba650892c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:36.455665 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1d6a4d40-f3f2-4c60-9377-98ba650892c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:36.457150 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1d6a4d40-f3f2-4c60-9377-98ba650892c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:36.457589 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1d6a4d40-f3f2-4c60-9377-98ba650892c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:36.485580 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1d6a4d40-f3f2-4c60-9377-98ba650892c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Going to try to terminate instance {{(pid=108440) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:41:36.654803 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2f2a1d13-f430-424a-9077-ed26243a607d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:36.655989 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2f2a1d13-f430-424a-9077-ed26243a607d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:36.663513 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2f2a1d13-f430-424a-9077-ed26243a607d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:36.663892 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2f2a1d13-f430-424a-9077-ed26243a607d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:36.664810 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2f2a1d13-f430-424a-9077-ed26243a607d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:36.665234 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2f2a1d13-f430-424a-9077-ed26243a607d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:36.790809 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2f2a1d13-f430-424a-9077-ed26243a607d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:36.797938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2f2a1d13-f430-424a-9077-ed26243a607d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1516 microversion: 2.1 time: 0.146800 Aug 10 03:41:36.798493 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 255/501] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:36 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1516 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:36.802714 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-231a82a1-5e26-4d68-9d54-92f6f93df63d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:36.803300 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-231a82a1-5e26-4d68-9d54-92f6f93df63d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:36.808710 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-231a82a1-5e26-4d68-9d54-92f6f93df63d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:36.809141 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-231a82a1-5e26-4d68-9d54-92f6f93df63d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:36.810329 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-231a82a1-5e26-4d68-9d54-92f6f93df63d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:36.810459 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-231a82a1-5e26-4d68-9d54-92f6f93df63d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:36.944605 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-231a82a1-5e26-4d68-9d54-92f6f93df63d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:36.951849 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-231a82a1-5e26-4d68-9d54-92f6f93df63d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1318 microversion: 2.1 time: 0.152416 Aug 10 03:41:36.955340 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1d6a4d40-f3f2-4c60-9377-98ba650892c7 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 204 len: 0 microversion: 2.1 time: 0.509677 Aug 10 03:41:36.956485 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 247/503] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:41:36 2021] DELETE /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:41:36.956596 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 256/503] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:36 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:36.964530 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3c8267cd-a3af-4d24-9bf2-c39942433f1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:36.965129 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3c8267cd-a3af-4d24-9bf2-c39942433f1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:36.971012 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3c8267cd-a3af-4d24-9bf2-c39942433f1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:36.971594 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3c8267cd-a3af-4d24-9bf2-c39942433f1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:36.972482 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3c8267cd-a3af-4d24-9bf2-c39942433f1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:36.972911 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3c8267cd-a3af-4d24-9bf2-c39942433f1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:36.978011 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6ba8f4e2-e414-4374-a5ef-2835ff6ffb69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:36.978718 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6ba8f4e2-e414-4374-a5ef-2835ff6ffb69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:36.984537 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6ba8f4e2-e414-4374-a5ef-2835ff6ffb69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:36.984985 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6ba8f4e2-e414-4374-a5ef-2835ff6ffb69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:36.986024 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6ba8f4e2-e414-4374-a5ef-2835ff6ffb69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:36.986617 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6ba8f4e2-e414-4374-a5ef-2835ff6ffb69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:37.103107 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3c8267cd-a3af-4d24-9bf2-c39942433f1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:37.110975 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3c8267cd-a3af-4d24-9bf2-c39942433f1e tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1502 microversion: 2.1 time: 0.150344 Aug 10 03:41:37.111619 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 257/504] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:36 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:37.157158 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6ba8f4e2-e414-4374-a5ef-2835ff6ffb69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:37.164853 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6ba8f4e2-e414-4374-a5ef-2835ff6ffb69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:37.166372 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6ba8f4e2-e414-4374-a5ef-2835ff6ffb69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:37.167508 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6ba8f4e2-e414-4374-a5ef-2835ff6ffb69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.193705 Aug 10 03:41:37.168094 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 248/505] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:36 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:41:37.969352 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ca1d5093-6886-41e2-ade0-4923cd001c68 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:37.970378 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ca1d5093-6886-41e2-ade0-4923cd001c68 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:37.977417 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ca1d5093-6886-41e2-ade0-4923cd001c68 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:37.977864 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ca1d5093-6886-41e2-ade0-4923cd001c68 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:37.978840 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ca1d5093-6886-41e2-ade0-4923cd001c68 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:37.979281 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ca1d5093-6886-41e2-ade0-4923cd001c68 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:38.104519 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ca1d5093-6886-41e2-ade0-4923cd001c68 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:38.112798 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ca1d5093-6886-41e2-ade0-4923cd001c68 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1318 microversion: 2.1 time: 0.147175 Aug 10 03:41:38.113368 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 258/506] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:37 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:38.131460 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-474b6fef-c624-4c00-958b-4035830c00fe tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:38.132131 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-474b6fef-c624-4c00-958b-4035830c00fe tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:38.138412 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-474b6fef-c624-4c00-958b-4035830c00fe tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:38.138886 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-474b6fef-c624-4c00-958b-4035830c00fe tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:38.140262 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-474b6fef-c624-4c00-958b-4035830c00fe tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:38.140701 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-474b6fef-c624-4c00-958b-4035830c00fe tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:38.186701 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3770bc76-6175-48ff-80e9-a6e307b15751 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:38.187937 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3770bc76-6175-48ff-80e9-a6e307b15751 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:38.194169 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3770bc76-6175-48ff-80e9-a6e307b15751 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:38.194619 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3770bc76-6175-48ff-80e9-a6e307b15751 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:38.198675 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3770bc76-6175-48ff-80e9-a6e307b15751 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:38.198675 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3770bc76-6175-48ff-80e9-a6e307b15751 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:38.300049 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-474b6fef-c624-4c00-958b-4035830c00fe tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:38.309419 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-474b6fef-c624-4c00-958b-4035830c00fe tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1502 microversion: 2.1 time: 0.181439 Aug 10 03:41:38.320127 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 249/507] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:38 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1502 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:38.331355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3770bc76-6175-48ff-80e9-a6e307b15751 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:38.339678 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3770bc76-6175-48ff-80e9-a6e307b15751 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:38.343550 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3770bc76-6175-48ff-80e9-a6e307b15751 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:38.343550 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3770bc76-6175-48ff-80e9-a6e307b15751 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.159401 Aug 10 03:41:38.343550 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 259/508] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:38 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:41:39.129536 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-df7f7463-4ae7-469e-bb97-620cea7307c6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:39.130154 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-df7f7463-4ae7-469e-bb97-620cea7307c6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:39.136458 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-df7f7463-4ae7-469e-bb97-620cea7307c6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:39.137057 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-df7f7463-4ae7-469e-bb97-620cea7307c6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:39.137713 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-df7f7463-4ae7-469e-bb97-620cea7307c6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:39.138226 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-df7f7463-4ae7-469e-bb97-620cea7307c6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:39.326570 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-334f6eb6-5aaa-4c22-8faf-74c1c318bfe3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:39.327777 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-334f6eb6-5aaa-4c22-8faf-74c1c318bfe3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:39.334251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-334f6eb6-5aaa-4c22-8faf-74c1c318bfe3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:39.334768 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-334f6eb6-5aaa-4c22-8faf-74c1c318bfe3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:39.335598 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-334f6eb6-5aaa-4c22-8faf-74c1c318bfe3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:39.336286 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-334f6eb6-5aaa-4c22-8faf-74c1c318bfe3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:39.359149 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-df7f7463-4ae7-469e-bb97-620cea7307c6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:39.368017 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-df7f7463-4ae7-469e-bb97-620cea7307c6 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1318 microversion: 2.1 time: 0.242076 Aug 10 03:41:39.369215 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 250/509] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:39 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:39.374992 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6dc9cebd-559e-4a21-aeee-ed8252de438a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:39.375822 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6dc9cebd-559e-4a21-aeee-ed8252de438a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:39.382834 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6dc9cebd-559e-4a21-aeee-ed8252de438a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:39.383602 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6dc9cebd-559e-4a21-aeee-ed8252de438a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:39.384729 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6dc9cebd-559e-4a21-aeee-ed8252de438a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:39.385397 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6dc9cebd-559e-4a21-aeee-ed8252de438a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:39.480138 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-334f6eb6-5aaa-4c22-8faf-74c1c318bfe3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:39.489418 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-334f6eb6-5aaa-4c22-8faf-74c1c318bfe3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1502 microversion: 2.1 time: 0.166344 Aug 10 03:41:39.492254 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 260/510] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:39 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:39.631625 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6dc9cebd-559e-4a21-aeee-ed8252de438a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:39.641253 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6dc9cebd-559e-4a21-aeee-ed8252de438a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:39.642878 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6dc9cebd-559e-4a21-aeee-ed8252de438a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:39.644306 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6dc9cebd-559e-4a21-aeee-ed8252de438a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.273582 Aug 10 03:41:39.644862 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 251/511] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:39 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:40.386803 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-141bc10e-13c2-4790-bed7-710055a29844 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:40.387799 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-141bc10e-13c2-4790-bed7-710055a29844 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:40.393928 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-141bc10e-13c2-4790-bed7-710055a29844 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:40.394356 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-141bc10e-13c2-4790-bed7-710055a29844 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:40.395430 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-141bc10e-13c2-4790-bed7-710055a29844 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:40.395854 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-141bc10e-13c2-4790-bed7-710055a29844 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:40.506982 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-2b0891d3-be53-40e7-95fc-7a3322cb24e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:40.507666 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-2b0891d3-be53-40e7-95fc-7a3322cb24e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:40.515253 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2b0891d3-be53-40e7-95fc-7a3322cb24e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:40.515818 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2b0891d3-be53-40e7-95fc-7a3322cb24e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:40.516826 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2b0891d3-be53-40e7-95fc-7a3322cb24e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:40.517261 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2b0891d3-be53-40e7-95fc-7a3322cb24e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:40.650735 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-2b0891d3-be53-40e7-95fc-7a3322cb24e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:40.659930 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-2b0891d3-be53-40e7-95fc-7a3322cb24e2 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1502 microversion: 2.1 time: 0.156547 Aug 10 03:41:40.670242 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 252/512] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:40 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:40.676522 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-80f90e0c-0860-4972-af0e-9f0e06513a83 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:40.677729 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-80f90e0c-0860-4972-af0e-9f0e06513a83 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:40.694009 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80f90e0c-0860-4972-af0e-9f0e06513a83 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:40.694462 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80f90e0c-0860-4972-af0e-9f0e06513a83 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:40.708592 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80f90e0c-0860-4972-af0e-9f0e06513a83 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:40.708592 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80f90e0c-0860-4972-af0e-9f0e06513a83 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:40.720763 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-141bc10e-13c2-4790-bed7-710055a29844 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:40.730273 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-141bc10e-13c2-4790-bed7-710055a29844 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1318 microversion: 2.1 time: 0.349091 Aug 10 03:41:40.730860 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 261/513] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:40 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:40.836274 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-80f90e0c-0860-4972-af0e-9f0e06513a83 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:40.845678 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-80f90e0c-0860-4972-af0e-9f0e06513a83 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:40.847311 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-80f90e0c-0860-4972-af0e-9f0e06513a83 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:40.848478 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-80f90e0c-0860-4972-af0e-9f0e06513a83 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.176376 Aug 10 03:41:40.849433 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 253/514] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:40 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:41.677032 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-bb056158-e006-4fa6-846a-7f3f401708a3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:41.678451 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-bb056158-e006-4fa6-846a-7f3f401708a3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:41.684645 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bb056158-e006-4fa6-846a-7f3f401708a3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:41.685320 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bb056158-e006-4fa6-846a-7f3f401708a3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:41.691771 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bb056158-e006-4fa6-846a-7f3f401708a3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:41.692479 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bb056158-e006-4fa6-846a-7f3f401708a3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:41.746925 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3aa6aebb-1e39-4345-8f7a-5c0beaa22e89 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:41.747834 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3aa6aebb-1e39-4345-8f7a-5c0beaa22e89 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:41.771586 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3aa6aebb-1e39-4345-8f7a-5c0beaa22e89 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:41.772096 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3aa6aebb-1e39-4345-8f7a-5c0beaa22e89 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:41.773125 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3aa6aebb-1e39-4345-8f7a-5c0beaa22e89 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:41.773400 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3aa6aebb-1e39-4345-8f7a-5c0beaa22e89 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:42.061450 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bb056158-e006-4fa6-846a-7f3f401708a3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:42.066365 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-bb056158-e006-4fa6-846a-7f3f401708a3 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1502 microversion: 2.1 time: 0.392835 Aug 10 03:41:42.080632 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 262/515] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:41 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1502 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:42.092598 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-9a20b3cc-fb34-473e-b507-f4319d2a8e45 req-69daf395-16bc-4723-b7f7-ac2bd37fd814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b772114c-6e12-41fc-b52a-f9bec5125afc", "name": "network-vif-plugged", "status": "completed", "tag": "089202fc-bf88-4e54-814b-80242a60ec09"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:42.095102 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:41:42.095102 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:41:42.096718 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3aa6aebb-1e39-4345-8f7a-5c0beaa22e89 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:42.102793 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-9a20b3cc-fb34-473e-b507-f4319d2a8e45 req-69daf395-16bc-4723-b7f7-ac2bd37fd814 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:42.103288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-9a20b3cc-fb34-473e-b507-f4319d2a8e45 req-69daf395-16bc-4723-b7f7-ac2bd37fd814 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:42.111852 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3aa6aebb-1e39-4345-8f7a-5c0beaa22e89 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1318 microversion: 2.1 time: 0.368523 Aug 10 03:41:42.113058 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 254/516] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:41 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:42.128669 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-69b0ebe2-5691-4223-b35a-58c0b13c3577 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:42.131885 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-69b0ebe2-5691-4223-b35a-58c0b13c3577 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:42.142065 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-9a20b3cc-fb34-473e-b507-f4319d2a8e45 req-69daf395-16bc-4723-b7f7-ac2bd37fd814 service nova] Creating event network-vif-plugged:089202fc-bf88-4e54-814b-80242a60ec09 for instance b772114c-6e12-41fc-b52a-f9bec5125afc on hv-cinder-78239 Aug 10 03:41:42.152451 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-9a20b3cc-fb34-473e-b507-f4319d2a8e45 req-69daf395-16bc-4723-b7f7-ac2bd37fd814 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068093 Aug 10 03:41:42.152906 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 263/517] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:41:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:41:42.153565 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-69b0ebe2-5691-4223-b35a-58c0b13c3577 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:42.154012 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-69b0ebe2-5691-4223-b35a-58c0b13c3577 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:42.154804 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-69b0ebe2-5691-4223-b35a-58c0b13c3577 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:42.155880 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-69b0ebe2-5691-4223-b35a-58c0b13c3577 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:42.167468 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b91dbe20-2cad-4403-a486-7be11a63fc10 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:42.168259 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b91dbe20-2cad-4403-a486-7be11a63fc10 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:42.181968 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b91dbe20-2cad-4403-a486-7be11a63fc10 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:42.184136 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b91dbe20-2cad-4403-a486-7be11a63fc10 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:42.186916 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b91dbe20-2cad-4403-a486-7be11a63fc10 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:42.187801 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b91dbe20-2cad-4403-a486-7be11a63fc10 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:42.395269 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b91dbe20-2cad-4403-a486-7be11a63fc10 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:42.406011 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b91dbe20-2cad-4403-a486-7be11a63fc10 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:42.407584 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b91dbe20-2cad-4403-a486-7be11a63fc10 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:42.408771 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b91dbe20-2cad-4403-a486-7be11a63fc10 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1744 microversion: 2.20 time: 0.254114 Aug 10 03:41:42.409789 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 264/518] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:42 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1744 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:42.447711 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-69b0ebe2-5691-4223-b35a-58c0b13c3577 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:42.457641 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-69b0ebe2-5691-4223-b35a-58c0b13c3577 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1516 microversion: 2.1 time: 0.343371 Aug 10 03:41:42.459111 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 255/519] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:42 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1516 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:42.476107 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-25984dff-3dc1-4fe4-a4e0-34e2de2a16d7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93916f10-f05b-432a-ac03-625b1adadb11"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:42.477705 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-25984dff-3dc1-4fe4-a4e0-34e2de2a16d7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:42.486633 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-25984dff-3dc1-4fe4-a4e0-34e2de2a16d7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:42.487344 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-25984dff-3dc1-4fe4-a4e0-34e2de2a16d7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:42.488319 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-25984dff-3dc1-4fe4-a4e0-34e2de2a16d7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:42.489697 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-25984dff-3dc1-4fe4-a4e0-34e2de2a16d7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:42.881573 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-b86fa43a-5301-4399-a881-122106943a60 req-62bda274-4e1d-4fba-85c1-1c4fc6b23074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6705722e-734f-44c2-b853-04ee58f5202d", "name": "network-vif-deleted", "tag": "befb1ced-df13-4ccc-9c87-fbef92863959"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:42.883625 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:41:42.883625 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:41:42.892370 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-b86fa43a-5301-4399-a881-122106943a60 req-62bda274-4e1d-4fba-85c1-1c4fc6b23074 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:42.893146 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-b86fa43a-5301-4399-a881-122106943a60 req-62bda274-4e1d-4fba-85c1-1c4fc6b23074 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:42.907070 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-b86fa43a-5301-4399-a881-122106943a60 req-62bda274-4e1d-4fba-85c1-1c4fc6b23074 service nova] Creating event network-vif-deleted:befb1ced-df13-4ccc-9c87-fbef92863959 for instance 6705722e-734f-44c2-b853-04ee58f5202d on hv-cinder-78239 Aug 10 03:41:42.913209 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-b86fa43a-5301-4399-a881-122106943a60 req-62bda274-4e1d-4fba-85c1-1c4fc6b23074 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035939 Aug 10 03:41:42.917262 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 256/520] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:41:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:41:43.003115 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-942be249-a830-4944-8c29-e02712cfd620 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:43.009951 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-942be249-a830-4944-8c29-e02712cfd620 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:43.010584 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-942be249-a830-4944-8c29-e02712cfd620 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:43.076281 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-942be249-a830-4944-8c29-e02712cfd620 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Going to try to stop instance {{(pid=108440) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Aug 10 03:41:43.301247 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-942be249-a830-4944-8c29-e02712cfd620 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 202 len: 0 microversion: 2.1 time: 0.302711 Aug 10 03:41:43.302468 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 257/521] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:42 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:41:43.310695 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-80df0f19-ea18-4bb1-9def-96f9e9b5aefb tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:43.310695 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-80df0f19-ea18-4bb1-9def-96f9e9b5aefb tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:43.317632 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80df0f19-ea18-4bb1-9def-96f9e9b5aefb tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:43.318326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80df0f19-ea18-4bb1-9def-96f9e9b5aefb tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:43.319203 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80df0f19-ea18-4bb1-9def-96f9e9b5aefb tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:43.319631 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80df0f19-ea18-4bb1-9def-96f9e9b5aefb tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:43.392112 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-80df0f19-ea18-4bb1-9def-96f9e9b5aefb tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:43.400214 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-80df0f19-ea18-4bb1-9def-96f9e9b5aefb tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1297 microversion: 2.1 time: 0.095961 Aug 10 03:41:43.400795 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 258/522] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:43 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:43.410536 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-288b7d46-e1e2-4800-aa87-33e8440bc77b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:43.410536 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-288b7d46-e1e2-4800-aa87-33e8440bc77b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:43.412415 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-288b7d46-e1e2-4800-aa87-33e8440bc77b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:43.412883 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-288b7d46-e1e2-4800-aa87-33e8440bc77b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:43.413662 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-288b7d46-e1e2-4800-aa87-33e8440bc77b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:43.414264 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-288b7d46-e1e2-4800-aa87-33e8440bc77b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:43.550453 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-288b7d46-e1e2-4800-aa87-33e8440bc77b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:43.558957 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-288b7d46-e1e2-4800-aa87-33e8440bc77b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1318 microversion: 2.1 time: 0.156477 Aug 10 03:41:43.559548 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 259/523] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:43 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:43.568416 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1129c3e3-5bb9-40fc-a7ea-825e8202e129 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:43.568985 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1129c3e3-5bb9-40fc-a7ea-825e8202e129 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:43.574896 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1129c3e3-5bb9-40fc-a7ea-825e8202e129 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:43.575339 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1129c3e3-5bb9-40fc-a7ea-825e8202e129 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:43.576115 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1129c3e3-5bb9-40fc-a7ea-825e8202e129 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:43.577807 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1129c3e3-5bb9-40fc-a7ea-825e8202e129 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:43.706733 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1129c3e3-5bb9-40fc-a7ea-825e8202e129 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:43.715867 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1129c3e3-5bb9-40fc-a7ea-825e8202e129 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.154634 Aug 10 03:41:43.716473 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 260/524] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:43 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:43.726284 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-39f12e73-008f-4632-8835-7d89e792f360 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:43.726284 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-39f12e73-008f-4632-8835-7d89e792f360 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:43.731369 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-39f12e73-008f-4632-8835-7d89e792f360 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:43.731846 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-39f12e73-008f-4632-8835-7d89e792f360 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:43.732651 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-39f12e73-008f-4632-8835-7d89e792f360 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:43.733150 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-39f12e73-008f-4632-8835-7d89e792f360 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:43.880066 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-39f12e73-008f-4632-8835-7d89e792f360 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:43.890264 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-39f12e73-008f-4632-8835-7d89e792f360 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:43.892794 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-39f12e73-008f-4632-8835-7d89e792f360 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:43.894177 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-39f12e73-008f-4632-8835-7d89e792f360 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1744 microversion: 2.20 time: 0.173682 Aug 10 03:41:43.895008 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 261/525] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:43 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:43.963321 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-25984dff-3dc1-4fe4-a4e0-34e2de2a16d7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "POST /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.486808 Aug 10 03:41:43.963321 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 265/526] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 10 03:41:42 2021] POST /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments => generated 194 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:41:44.418961 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-07d6e3f6-0592-429f-a755-ef2440b4cf57 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:44.420149 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-07d6e3f6-0592-429f-a755-ef2440b4cf57 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:44.430138 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-07d6e3f6-0592-429f-a755-ef2440b4cf57 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:44.430613 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-07d6e3f6-0592-429f-a755-ef2440b4cf57 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:44.431421 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-07d6e3f6-0592-429f-a755-ef2440b4cf57 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:44.432171 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-07d6e3f6-0592-429f-a755-ef2440b4cf57 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:44.467930 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-07d6e3f6-0592-429f-a755-ef2440b4cf57 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:44.468661 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-07d6e3f6-0592-429f-a755-ef2440b4cf57 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:44.469310 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-07d6e3f6-0592-429f-a755-ef2440b4cf57 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lazy-loading 'fault' on Instance uuid 6705722e-734f-44c2-b853-04ee58f5202d {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:41:44.513733 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-07d6e3f6-0592-429f-a755-ef2440b4cf57 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84491dcbe2d1410a8d7557538c91c204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb8b2b63114fd68f07ec997a49a162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:44.521509 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-07d6e3f6-0592-429f-a755-ef2440b4cf57 tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 200 len: 1302 microversion: 2.1 time: 0.106806 Aug 10 03:41:44.523266 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 262/527] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:44 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 1302 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:44.576898 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-726785f6-8e70-462c-b197-0fbd694de35e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:44.584392 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-726785f6-8e70-462c-b197-0fbd694de35e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:44.584789 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-726785f6-8e70-462c-b197-0fbd694de35e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:44.585234 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-726785f6-8e70-462c-b197-0fbd694de35e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:44.586018 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-726785f6-8e70-462c-b197-0fbd694de35e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:44.586424 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-726785f6-8e70-462c-b197-0fbd694de35e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:44.742224 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b70bad51-26ed-42a8-a5e8-8666b8ab2216 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:44.743437 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b70bad51-26ed-42a8-a5e8-8666b8ab2216 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:44.757550 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b70bad51-26ed-42a8-a5e8-8666b8ab2216 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:44.759528 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b70bad51-26ed-42a8-a5e8-8666b8ab2216 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:44.764283 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b70bad51-26ed-42a8-a5e8-8666b8ab2216 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:44.764283 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b70bad51-26ed-42a8-a5e8-8666b8ab2216 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:44.820160 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-726785f6-8e70-462c-b197-0fbd694de35e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:44.828008 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-726785f6-8e70-462c-b197-0fbd694de35e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1318 microversion: 2.1 time: 0.255734 Aug 10 03:41:44.828611 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 266/528] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:44 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:44.916867 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a07c0a7a-23da-49b4-8ec4-dd04109a523f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:44.917928 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a07c0a7a-23da-49b4-8ec4-dd04109a523f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:44.929981 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a07c0a7a-23da-49b4-8ec4-dd04109a523f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:44.931030 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a07c0a7a-23da-49b4-8ec4-dd04109a523f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:44.932617 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a07c0a7a-23da-49b4-8ec4-dd04109a523f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:44.933529 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a07c0a7a-23da-49b4-8ec4-dd04109a523f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:45.006155 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b70bad51-26ed-42a8-a5e8-8666b8ab2216 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:45.014151 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b70bad51-26ed-42a8-a5e8-8666b8ab2216 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.283226 Aug 10 03:41:45.015251 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 263/529] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:44 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:45.212977 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a07c0a7a-23da-49b4-8ec4-dd04109a523f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:45.229943 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a07c0a7a-23da-49b4-8ec4-dd04109a523f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:45.229943 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a07c0a7a-23da-49b4-8ec4-dd04109a523f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:45.229943 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a07c0a7a-23da-49b4-8ec4-dd04109a523f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1744 microversion: 2.20 time: 0.311916 Aug 10 03:41:45.230468 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 267/530] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:44 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1744 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:45.540498 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4f44585b-0fd3-489d-ab37-1ad09bef4bda tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:45.541729 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4f44585b-0fd3-489d-ab37-1ad09bef4bda tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] [instance: 6705722e-734f-44c2-b853-04ee58f5202d] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:45.549073 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4f44585b-0fd3-489d-ab37-1ad09bef4bda tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:45.549796 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4f44585b-0fd3-489d-ab37-1ad09bef4bda tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:45.550796 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4f44585b-0fd3-489d-ab37-1ad09bef4bda tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:45.551655 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4f44585b-0fd3-489d-ab37-1ad09bef4bda tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:45.569078 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-4f44585b-0fd3-489d-ab37-1ad09bef4bda tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] HTTP exception thrown: Instance 6705722e-734f-44c2-b853-04ee58f5202d could not be found. Aug 10 03:41:45.570596 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4f44585b-0fd3-489d-ab37-1ad09bef4bda tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] Returning 404 to user: Instance 6705722e-734f-44c2-b853-04ee58f5202d could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:41:45.570992 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4f44585b-0fd3-489d-ab37-1ad09bef4bda tempest-VolumesActionsTest-2001796243 tempest-VolumesActionsTest-2001796243-project] 10.222.0.21 "GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d" status: 404 len: 111 microversion: 2.1 time: 0.034328 Aug 10 03:41:45.571711 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 264/531] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:45 2021] GET /compute/v2.1/servers/6705722e-734f-44c2-b853-04ee58f5202d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:41:45.845010 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a9091ad8-7b5d-478a-b5e9-cf69712e8d41 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:45.845623 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a9091ad8-7b5d-478a-b5e9-cf69712e8d41 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:45.851615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a9091ad8-7b5d-478a-b5e9-cf69712e8d41 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:45.851961 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a9091ad8-7b5d-478a-b5e9-cf69712e8d41 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:45.852948 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a9091ad8-7b5d-478a-b5e9-cf69712e8d41 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:45.853457 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a9091ad8-7b5d-478a-b5e9-cf69712e8d41 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:46.023343 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a9091ad8-7b5d-478a-b5e9-cf69712e8d41 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:46.033346 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a9091ad8-7b5d-478a-b5e9-cf69712e8d41 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1508 microversion: 2.1 time: 0.192008 Aug 10 03:41:46.034323 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 268/532] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:45 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:46.060874 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-43ec0d20-7dba-4607-a8b2-a0f56505d046 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:46.062034 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-43ec0d20-7dba-4607-a8b2-a0f56505d046 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:46.069343 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43ec0d20-7dba-4607-a8b2-a0f56505d046 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:46.071513 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43ec0d20-7dba-4607-a8b2-a0f56505d046 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:46.080979 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43ec0d20-7dba-4607-a8b2-a0f56505d046 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:46.082104 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43ec0d20-7dba-4607-a8b2-a0f56505d046 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:46.249843 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-95bcfee3-5c60-4703-9767-fd3bcfc5ca40 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:46.250622 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-95bcfee3-5c60-4703-9767-fd3bcfc5ca40 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:46.273507 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-95bcfee3-5c60-4703-9767-fd3bcfc5ca40 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:46.275399 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-95bcfee3-5c60-4703-9767-fd3bcfc5ca40 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:46.276543 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-95bcfee3-5c60-4703-9767-fd3bcfc5ca40 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:46.277671 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-95bcfee3-5c60-4703-9767-fd3bcfc5ca40 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:46.298161 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-43ec0d20-7dba-4607-a8b2-a0f56505d046 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:46.307926 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-43ec0d20-7dba-4607-a8b2-a0f56505d046 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.254443 Aug 10 03:41:46.328582 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 265/533] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:46 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:46.333734 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-d07cc500-c1d3-425d-a4e4-85193bbeb47f req-2d438f1f-b87d-4e8b-8a27-266c28c138ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c599984-f271-4886-be2f-73e7531f52e4", "name": "network-vif-plugged", "status": "completed", "tag": "54a387d8-dbe0-4a78-bbba-58f771dd4478"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:46.335565 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:41:46.335565 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:41:46.352550 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-d07cc500-c1d3-425d-a4e4-85193bbeb47f req-2d438f1f-b87d-4e8b-8a27-266c28c138ce service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:46.353273 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-d07cc500-c1d3-425d-a4e4-85193bbeb47f req-2d438f1f-b87d-4e8b-8a27-266c28c138ce service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:46.367559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-d07cc500-c1d3-425d-a4e4-85193bbeb47f req-2d438f1f-b87d-4e8b-8a27-266c28c138ce service nova] Creating event network-vif-plugged:54a387d8-dbe0-4a78-bbba-58f771dd4478 for instance 0c599984-f271-4886-be2f-73e7531f52e4 on hv-cinder-78239 Aug 10 03:41:46.382027 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-d07cc500-c1d3-425d-a4e4-85193bbeb47f req-2d438f1f-b87d-4e8b-8a27-266c28c138ce service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051821 Aug 10 03:41:46.382629 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 266/534] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:41:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:41:46.635035 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-95bcfee3-5c60-4703-9767-fd3bcfc5ca40 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:46.646306 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-95bcfee3-5c60-4703-9767-fd3bcfc5ca40 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:46.648608 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-95bcfee3-5c60-4703-9767-fd3bcfc5ca40 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:46.654247 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-95bcfee3-5c60-4703-9767-fd3bcfc5ca40 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1739 microversion: 2.20 time: 0.405811 Aug 10 03:41:46.654247 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 269/535] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:46 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1739 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:47.329217 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-54e54e07-b583-47c6-b482-b06cb6888fc1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:47.330006 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-54e54e07-b583-47c6-b482-b06cb6888fc1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:47.337378 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-54e54e07-b583-47c6-b482-b06cb6888fc1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:47.346413 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-54e54e07-b583-47c6-b482-b06cb6888fc1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:47.348069 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-54e54e07-b583-47c6-b482-b06cb6888fc1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:47.356129 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-54e54e07-b583-47c6-b482-b06cb6888fc1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:47.674168 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-aee36dc4-c3c8-4376-b61d-399144670cc2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:47.675660 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-aee36dc4-c3c8-4376-b61d-399144670cc2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:47.686782 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aee36dc4-c3c8-4376-b61d-399144670cc2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:47.689283 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aee36dc4-c3c8-4376-b61d-399144670cc2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:47.692605 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aee36dc4-c3c8-4376-b61d-399144670cc2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:47.693153 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aee36dc4-c3c8-4376-b61d-399144670cc2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:47.697746 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-54e54e07-b583-47c6-b482-b06cb6888fc1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:47.712777 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-54e54e07-b583-47c6-b482-b06cb6888fc1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.389101 Aug 10 03:41:47.713365 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 267/536] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:47 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:48.124551 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-aee36dc4-c3c8-4376-b61d-399144670cc2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:48.136790 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-aee36dc4-c3c8-4376-b61d-399144670cc2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:48.142673 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-aee36dc4-c3c8-4376-b61d-399144670cc2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:48.145355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-aee36dc4-c3c8-4376-b61d-399144670cc2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1739 microversion: 2.20 time: 0.474308 Aug 10 03:41:48.156711 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 270/537] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:47 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1739 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:41:48.476462 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-874c266c-a330-4e1d-b2f9-38f9af9b72ee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "647e683c-a4b5-4345-9e61-7885a0305a1f"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:48.487529 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-874c266c-a330-4e1d-b2f9-38f9af9b72ee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:48.513210 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-874c266c-a330-4e1d-b2f9-38f9af9b72ee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:48.517110 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-874c266c-a330-4e1d-b2f9-38f9af9b72ee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:48.521187 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-874c266c-a330-4e1d-b2f9-38f9af9b72ee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:48.521854 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-874c266c-a330-4e1d-b2f9-38f9af9b72ee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:48.731122 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3031c606-2994-45cd-8e7e-709d10155550 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:48.731982 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3031c606-2994-45cd-8e7e-709d10155550 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:48.747081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3031c606-2994-45cd-8e7e-709d10155550 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:48.747528 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3031c606-2994-45cd-8e7e-709d10155550 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:48.748344 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3031c606-2994-45cd-8e7e-709d10155550 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:48.749340 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3031c606-2994-45cd-8e7e-709d10155550 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:48.971872 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3031c606-2994-45cd-8e7e-709d10155550 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:48.981793 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3031c606-2994-45cd-8e7e-709d10155550 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.254589 Aug 10 03:41:48.982748 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 271/538] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:48 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:49.164011 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c7c5dd0f-ad18-43ce-89e2-432a5366ae57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:49.165569 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c7c5dd0f-ad18-43ce-89e2-432a5366ae57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:49.175061 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c7c5dd0f-ad18-43ce-89e2-432a5366ae57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:49.175829 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c7c5dd0f-ad18-43ce-89e2-432a5366ae57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:49.177119 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c7c5dd0f-ad18-43ce-89e2-432a5366ae57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:49.177987 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c7c5dd0f-ad18-43ce-89e2-432a5366ae57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:49.808697 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c7c5dd0f-ad18-43ce-89e2-432a5366ae57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:49.824471 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c7c5dd0f-ad18-43ce-89e2-432a5366ae57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:49.825820 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c7c5dd0f-ad18-43ce-89e2-432a5366ae57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:49.833305 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c7c5dd0f-ad18-43ce-89e2-432a5366ae57 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1739 microversion: 2.20 time: 0.667105 Aug 10 03:41:49.839593 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 272/539] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:49 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1739 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:50.002027 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-958fbbef-2a1b-458b-a2ef-e24be3a73812 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:50.003022 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-958fbbef-2a1b-458b-a2ef-e24be3a73812 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:50.013312 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-958fbbef-2a1b-458b-a2ef-e24be3a73812 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:50.014094 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-958fbbef-2a1b-458b-a2ef-e24be3a73812 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:50.017149 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-958fbbef-2a1b-458b-a2ef-e24be3a73812 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:50.017781 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-958fbbef-2a1b-458b-a2ef-e24be3a73812 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:50.309275 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-958fbbef-2a1b-458b-a2ef-e24be3a73812 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:50.322897 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-958fbbef-2a1b-458b-a2ef-e24be3a73812 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.326932 Aug 10 03:41:50.325368 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 273/540] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:49 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:50.866862 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-33200c42-3292-4558-a101-7d07dbccd620 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:50.867973 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-33200c42-3292-4558-a101-7d07dbccd620 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:50.886780 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-33200c42-3292-4558-a101-7d07dbccd620 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:50.886780 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-33200c42-3292-4558-a101-7d07dbccd620 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:50.887790 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-33200c42-3292-4558-a101-7d07dbccd620 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:50.887978 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-33200c42-3292-4558-a101-7d07dbccd620 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:51.362751 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-33200c42-3292-4558-a101-7d07dbccd620 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:51.376221 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-33200c42-3292-4558-a101-7d07dbccd620 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:51.378473 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-33200c42-3292-4558-a101-7d07dbccd620 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:51.379897 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-33200c42-3292-4558-a101-7d07dbccd620 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1739 microversion: 2.20 time: 0.525486 Aug 10 03:41:51.380826 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 274/541] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:50 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1739 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:41:51.397088 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-54da465d-4228-47f2-81a9-e177a43c7272 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:51.402226 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-54da465d-4228-47f2-81a9-e177a43c7272 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:51.406693 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54da465d-4228-47f2-81a9-e177a43c7272 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:51.408228 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54da465d-4228-47f2-81a9-e177a43c7272 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:51.409512 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54da465d-4228-47f2-81a9-e177a43c7272 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:51.410166 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54da465d-4228-47f2-81a9-e177a43c7272 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:51.682882 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-54da465d-4228-47f2-81a9-e177a43c7272 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:51.692864 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-54da465d-4228-47f2-81a9-e177a43c7272 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.310308 Aug 10 03:41:51.723361 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 275/542] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:51 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:52.413699 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b122d39a-fd51-479d-b28a-fa2607aafd84 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:52.415206 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b122d39a-fd51-479d-b28a-fa2607aafd84 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:52.429949 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b122d39a-fd51-479d-b28a-fa2607aafd84 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:52.431709 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b122d39a-fd51-479d-b28a-fa2607aafd84 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:52.435613 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b122d39a-fd51-479d-b28a-fa2607aafd84 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:52.438768 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b122d39a-fd51-479d-b28a-fa2607aafd84 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:52.750989 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b122d39a-fd51-479d-b28a-fa2607aafd84 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:52.762028 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b122d39a-fd51-479d-b28a-fa2607aafd84 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:52.769035 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b122d39a-fd51-479d-b28a-fa2607aafd84 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:52.778774 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b122d39a-fd51-479d-b28a-fa2607aafd84 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1739 microversion: 2.20 time: 0.363740 Aug 10 03:41:52.780548 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 276/543] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:52 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1739 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:41:52.791357 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d8308d2a-fa9d-4240-ae5c-6c37490cda75 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:52.791952 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d8308d2a-fa9d-4240-ae5c-6c37490cda75 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:52.808093 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d8308d2a-fa9d-4240-ae5c-6c37490cda75 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:52.808543 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d8308d2a-fa9d-4240-ae5c-6c37490cda75 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:52.812038 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d8308d2a-fa9d-4240-ae5c-6c37490cda75 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:52.812674 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d8308d2a-fa9d-4240-ae5c-6c37490cda75 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:53.036799 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-874c266c-a330-4e1d-b2f9-38f9af9b72ee tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "POST /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.564019 Aug 10 03:41:53.038370 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 268/544] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 10 03:41:48 2021] POST /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc/os-volume_attachments => generated 194 bytes in 4567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:41:53.286886 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d8308d2a-fa9d-4240-ae5c-6c37490cda75 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:53.327910 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d8308d2a-fa9d-4240-ae5c-6c37490cda75 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.543306 Aug 10 03:41:53.329090 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 277/545] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:52 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:53.828071 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-2530c213-3e84-461c-bde9-f9d787e682f2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:53.840409 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-2530c213-3e84-461c-bde9-f9d787e682f2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:53.882066 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2530c213-3e84-461c-bde9-f9d787e682f2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:53.883477 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2530c213-3e84-461c-bde9-f9d787e682f2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:53.888071 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2530c213-3e84-461c-bde9-f9d787e682f2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:53.890879 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2530c213-3e84-461c-bde9-f9d787e682f2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:54.351303 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-fb3de11f-988c-456a-9c22-2166bcb057a9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:54.351303 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-fb3de11f-988c-456a-9c22-2166bcb057a9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:54.363154 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fb3de11f-988c-456a-9c22-2166bcb057a9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:54.368514 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fb3de11f-988c-456a-9c22-2166bcb057a9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:54.370327 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fb3de11f-988c-456a-9c22-2166bcb057a9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:54.371354 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fb3de11f-988c-456a-9c22-2166bcb057a9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:54.421531 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-2530c213-3e84-461c-bde9-f9d787e682f2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:54.462896 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-2530c213-3e84-461c-bde9-f9d787e682f2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:54.472140 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-2530c213-3e84-461c-bde9-f9d787e682f2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:54.479290 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-2530c213-3e84-461c-bde9-f9d787e682f2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1739 microversion: 2.20 time: 0.660954 Aug 10 03:41:54.501012 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 269/546] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:53 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1739 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:54.996748 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e97dd041-e856-44a1-9d59-c4593dc85c67 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:55.000069 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e97dd041-e856-44a1-9d59-c4593dc85c67 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:55.004334 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-fb3de11f-988c-456a-9c22-2166bcb057a9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:55.015387 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-fb3de11f-988c-456a-9c22-2166bcb057a9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.673079 Aug 10 03:41:55.017114 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 278/547] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:54 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:55.018884 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e97dd041-e856-44a1-9d59-c4593dc85c67 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:55.021324 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e97dd041-e856-44a1-9d59-c4593dc85c67 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:55.022432 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e97dd041-e856-44a1-9d59-c4593dc85c67 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:55.023040 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e97dd041-e856-44a1-9d59-c4593dc85c67 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:55.085261 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-e97dd041-e856-44a1-9d59-c4593dc85c67 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lazy-loading 'flavor' on Instance uuid f2c37d94-d078-4e35-819d-2ca11fc5cb5f {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:41:55.644246 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e97dd041-e856-44a1-9d59-c4593dc85c67 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "POST /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/action" status: 200 len: 32 microversion: 2.1 time: 0.661458 Aug 10 03:41:55.670403 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 270/548] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:41:54 2021] POST /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/action => generated 32 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 03:41:55.685079 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b73e3ed1-7528-47bc-9be0-4a753f353a32 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:55.703913 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b73e3ed1-7528-47bc-9be0-4a753f353a32 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:55.711353 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b73e3ed1-7528-47bc-9be0-4a753f353a32 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:55.712144 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b73e3ed1-7528-47bc-9be0-4a753f353a32 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:55.713234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b73e3ed1-7528-47bc-9be0-4a753f353a32 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:55.713862 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b73e3ed1-7528-47bc-9be0-4a753f353a32 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:55.722844 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-4fd318df-c167-4210-9dda-bc800a0ae20a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Action: 'create', calling method: .version_select at 0x7f97a15e4550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1117142228"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:41:55.843256 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-4fd318df-c167-4210-9dda-bc800a0ae20a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Getting quotas for project 77aab94ffcab4a8b9ad529c5a5454ae9. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:41:55.865329 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-4fd318df-c167-4210-9dda-bc800a0ae20a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Getting quotas for user f35d508678b14f2583abf9ba5ae7fb91 and project 77aab94ffcab4a8b9ad529c5a5454ae9. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:41:56.192238 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-4fd318df-c167-4210-9dda-bc800a0ae20a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Getting quotas for project 77aab94ffcab4a8b9ad529c5a5454ae9. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:41:56.209664 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b73e3ed1-7528-47bc-9be0-4a753f353a32 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:56.224470 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-4fd318df-c167-4210-9dda-bc800a0ae20a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Getting quotas for user f35d508678b14f2583abf9ba5ae7fb91 and project 77aab94ffcab4a8b9ad529c5a5454ae9. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:41:56.247368 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b73e3ed1-7528-47bc-9be0-4a753f353a32 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:56.249402 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b73e3ed1-7528-47bc-9be0-4a753f353a32 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:56.257307 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b73e3ed1-7528-47bc-9be0-4a753f353a32 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1739 microversion: 2.20 time: 0.584925 Aug 10 03:41:56.257962 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 271/549] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:55 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1739 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:56.284134 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-48643828-cec8-43d4-864e-151c962f1b70 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:56.285379 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-48643828-cec8-43d4-864e-151c962f1b70 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:56.290402 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-4fd318df-c167-4210-9dda-bc800a0ae20a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 1.133388 Aug 10 03:41:56.296244 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 279/550] 10.222.0.21 () {60 vars in 1158 bytes} [Tue Aug 10 03:41:55 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:56.313688 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-48643828-cec8-43d4-864e-151c962f1b70 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:56.316176 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-323ba093-eb84-451a-a861-75e88baad6b7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:56.317054 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-48643828-cec8-43d4-864e-151c962f1b70 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:56.318810 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-48643828-cec8-43d4-864e-151c962f1b70 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:56.322770 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-323ba093-eb84-451a-a861-75e88baad6b7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:56.323414 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-48643828-cec8-43d4-864e-151c962f1b70 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:56.351339 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-323ba093-eb84-451a-a861-75e88baad6b7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:56.352642 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-323ba093-eb84-451a-a861-75e88baad6b7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:56.389740 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-323ba093-eb84-451a-a861-75e88baad6b7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:56.392848 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-323ba093-eb84-451a-a861-75e88baad6b7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:57.263608 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-48643828-cec8-43d4-864e-151c962f1b70 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:57.288956 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-48643828-cec8-43d4-864e-151c962f1b70 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 1.014766 Aug 10 03:41:57.391019 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 272/551] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:56 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:57.391019 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-5ae20269-3bbb-4844-8409-13aa20b12ef6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:57.391019 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-5ae20269-3bbb-4844-8409-13aa20b12ef6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:57.391019 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5ae20269-3bbb-4844-8409-13aa20b12ef6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:57.391461 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5ae20269-3bbb-4844-8409-13aa20b12ef6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:57.391461 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5ae20269-3bbb-4844-8409-13aa20b12ef6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:57.391461 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5ae20269-3bbb-4844-8409-13aa20b12ef6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:57.737231 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-323ba093-eb84-451a-a861-75e88baad6b7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:57.753002 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-323ba093-eb84-451a-a861-75e88baad6b7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 1.452145 Aug 10 03:41:57.756979 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-5ae20269-3bbb-4844-8409-13aa20b12ef6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:57.763863 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 280/552] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:56 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:57.778420 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-5ae20269-3bbb-4844-8409-13aa20b12ef6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:57.797325 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-5ae20269-3bbb-4844-8409-13aa20b12ef6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:57.806923 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-5ae20269-3bbb-4844-8409-13aa20b12ef6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1739 microversion: 2.20 time: 0.505027 Aug 10 03:41:57.811087 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 273/553] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:57 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1739 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:41:58.377355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2d783536-1d89-4a18-92d1-fbb5538048d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:58.379483 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2d783536-1d89-4a18-92d1-fbb5538048d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:58.400239 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2d783536-1d89-4a18-92d1-fbb5538048d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:58.420134 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2d783536-1d89-4a18-92d1-fbb5538048d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:58.420134 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2d783536-1d89-4a18-92d1-fbb5538048d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:58.420134 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2d783536-1d89-4a18-92d1-fbb5538048d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:58.720807 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2d783536-1d89-4a18-92d1-fbb5538048d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:58.744073 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2d783536-1d89-4a18-92d1-fbb5538048d3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.370718 Aug 10 03:41:58.752295 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 281/554] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:58 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:41:58.771847 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8c055d02-2ee8-4714-882a-9134cc072dfd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:58.772512 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8c055d02-2ee8-4714-882a-9134cc072dfd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:58.784881 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8c055d02-2ee8-4714-882a-9134cc072dfd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:58.787476 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8c055d02-2ee8-4714-882a-9134cc072dfd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:58.791949 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8c055d02-2ee8-4714-882a-9134cc072dfd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:58.793161 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8c055d02-2ee8-4714-882a-9134cc072dfd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:58.835130 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3b856d22-8fd6-4918-9390-1e5800f9f75e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:58.835936 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3b856d22-8fd6-4918-9390-1e5800f9f75e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:58.848285 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3b856d22-8fd6-4918-9390-1e5800f9f75e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:58.849491 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3b856d22-8fd6-4918-9390-1e5800f9f75e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:58.851169 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3b856d22-8fd6-4918-9390-1e5800f9f75e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:58.851618 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3b856d22-8fd6-4918-9390-1e5800f9f75e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:59.057023 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-8c055d02-2ee8-4714-882a-9134cc072dfd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:59.097212 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8c055d02-2ee8-4714-882a-9134cc072dfd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.325041 Aug 10 03:41:59.103243 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 274/555] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:58 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:41:59.152938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3b856d22-8fd6-4918-9390-1e5800f9f75e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:59.166159 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3b856d22-8fd6-4918-9390-1e5800f9f75e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:59.172428 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3b856d22-8fd6-4918-9390-1e5800f9f75e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:41:59.178559 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3b856d22-8fd6-4918-9390-1e5800f9f75e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1739 microversion: 2.20 time: 0.348159 Aug 10 03:41:59.196322 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 282/556] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:41:58 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1739 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:41:59.775973 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1e48fe38-7f58-487d-af58-7d4a39da1770 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:41:59.777150 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1e48fe38-7f58-487d-af58-7d4a39da1770 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:41:59.816101 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1e48fe38-7f58-487d-af58-7d4a39da1770 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:59.816101 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1e48fe38-7f58-487d-af58-7d4a39da1770 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:41:59.816101 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1e48fe38-7f58-487d-af58-7d4a39da1770 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:41:59.816101 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1e48fe38-7f58-487d-af58-7d4a39da1770 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:00.100643 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1e48fe38-7f58-487d-af58-7d4a39da1770 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:00.120811 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-887b4fd1-e662-40f5-a6df-96278892585c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:00.121656 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-887b4fd1-e662-40f5-a6df-96278892585c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:00.145124 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1e48fe38-7f58-487d-af58-7d4a39da1770 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.378782 Aug 10 03:42:00.148346 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 275/557] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:41:59 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:00.150782 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-887b4fd1-e662-40f5-a6df-96278892585c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:00.151863 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-887b4fd1-e662-40f5-a6df-96278892585c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:00.155166 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-887b4fd1-e662-40f5-a6df-96278892585c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:00.155693 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-887b4fd1-e662-40f5-a6df-96278892585c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:00.223579 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d5b6b909-308f-4bc8-a85a-feb0be03940e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:00.226226 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d5b6b909-308f-4bc8-a85a-feb0be03940e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:00.243361 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d5b6b909-308f-4bc8-a85a-feb0be03940e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:00.254285 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d5b6b909-308f-4bc8-a85a-feb0be03940e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:00.254285 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d5b6b909-308f-4bc8-a85a-feb0be03940e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:00.254285 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d5b6b909-308f-4bc8-a85a-feb0be03940e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:00.516548 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d5b6b909-308f-4bc8-a85a-feb0be03940e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:00.526419 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d5b6b909-308f-4bc8-a85a-feb0be03940e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:00.553430 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d5b6b909-308f-4bc8-a85a-feb0be03940e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:00.557648 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d5b6b909-308f-4bc8-a85a-feb0be03940e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1739 microversion: 2.20 time: 0.347847 Aug 10 03:42:00.558410 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 276/558] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:00 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1739 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:00.673157 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-887b4fd1-e662-40f5-a6df-96278892585c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:00.683938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-887b4fd1-e662-40f5-a6df-96278892585c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.567498 Aug 10 03:42:00.686880 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 283/559] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:00 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:01.166914 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-9ab9494e-1c30-4e8c-9e13-d91186c942e3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:01.167511 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-9ab9494e-1c30-4e8c-9e13-d91186c942e3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:01.178465 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9ab9494e-1c30-4e8c-9e13-d91186c942e3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:01.182469 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9ab9494e-1c30-4e8c-9e13-d91186c942e3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:01.182469 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9ab9494e-1c30-4e8c-9e13-d91186c942e3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:01.182469 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9ab9494e-1c30-4e8c-9e13-d91186c942e3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:01.537151 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9ab9494e-1c30-4e8c-9e13-d91186c942e3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:01.560319 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-9ab9494e-1c30-4e8c-9e13-d91186c942e3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.397002 Aug 10 03:42:01.561766 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 277/560] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:01 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:01.579343 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-eb25a585-e90d-4b0d-af3a-5229b37bb34a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:01.579976 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-eb25a585-e90d-4b0d-af3a-5229b37bb34a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:01.600439 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-eb25a585-e90d-4b0d-af3a-5229b37bb34a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:01.600898 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-eb25a585-e90d-4b0d-af3a-5229b37bb34a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:01.601727 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-eb25a585-e90d-4b0d-af3a-5229b37bb34a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:01.602186 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-eb25a585-e90d-4b0d-af3a-5229b37bb34a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:01.712787 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ef6fd38e-c4b3-46e0-81ac-0923cde8436a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:01.713486 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ef6fd38e-c4b3-46e0-81ac-0923cde8436a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:01.730729 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ef6fd38e-c4b3-46e0-81ac-0923cde8436a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:01.731182 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ef6fd38e-c4b3-46e0-81ac-0923cde8436a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:01.740657 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ef6fd38e-c4b3-46e0-81ac-0923cde8436a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:01.754262 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ef6fd38e-c4b3-46e0-81ac-0923cde8436a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:02.131139 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ef6fd38e-c4b3-46e0-81ac-0923cde8436a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:02.144121 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ef6fd38e-c4b3-46e0-81ac-0923cde8436a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.436941 Aug 10 03:42:02.156338 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 278/561] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:01 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:02.284098 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-eb25a585-e90d-4b0d-af3a-5229b37bb34a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:02.302101 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-eb25a585-e90d-4b0d-af3a-5229b37bb34a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:02.304972 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-eb25a585-e90d-4b0d-af3a-5229b37bb34a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:02.314465 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-eb25a585-e90d-4b0d-af3a-5229b37bb34a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1739 microversion: 2.20 time: 0.740789 Aug 10 03:42:02.319728 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 284/562] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:01 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1739 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:02.600505 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d17f5833-b651-4990-b243-8b7210121b09 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:02.601752 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d17f5833-b651-4990-b243-8b7210121b09 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:02.633099 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d17f5833-b651-4990-b243-8b7210121b09 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:02.634531 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d17f5833-b651-4990-b243-8b7210121b09 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:02.634803 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d17f5833-b651-4990-b243-8b7210121b09 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:02.637436 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d17f5833-b651-4990-b243-8b7210121b09 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:02.992116 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d17f5833-b651-4990-b243-8b7210121b09 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:03.019197 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d17f5833-b651-4990-b243-8b7210121b09 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.431595 Aug 10 03:42:03.020823 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 279/563] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:02 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:03.163524 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-712f75f9-a648-4a87-98c6-193ce9111e3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:03.164105 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-712f75f9-a648-4a87-98c6-193ce9111e3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:03.216852 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-712f75f9-a648-4a87-98c6-193ce9111e3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:03.220518 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-712f75f9-a648-4a87-98c6-193ce9111e3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:03.227529 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-712f75f9-a648-4a87-98c6-193ce9111e3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:03.227827 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-712f75f9-a648-4a87-98c6-193ce9111e3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:03.334857 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3353ed4a-66ab-47a9-89eb-98ed8e2353cf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:03.335473 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3353ed4a-66ab-47a9-89eb-98ed8e2353cf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:03.346169 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3353ed4a-66ab-47a9-89eb-98ed8e2353cf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:03.346613 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3353ed4a-66ab-47a9-89eb-98ed8e2353cf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:03.347518 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3353ed4a-66ab-47a9-89eb-98ed8e2353cf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:03.348173 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3353ed4a-66ab-47a9-89eb-98ed8e2353cf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:03.542379 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-712f75f9-a648-4a87-98c6-193ce9111e3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:03.553916 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-712f75f9-a648-4a87-98c6-193ce9111e3a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.395182 Aug 10 03:42:03.555281 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 285/564] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:03 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:03.680110 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3353ed4a-66ab-47a9-89eb-98ed8e2353cf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:03.691336 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3353ed4a-66ab-47a9-89eb-98ed8e2353cf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:03.694034 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3353ed4a-66ab-47a9-89eb-98ed8e2353cf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:03.695977 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3353ed4a-66ab-47a9-89eb-98ed8e2353cf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1739 microversion: 2.20 time: 0.364839 Aug 10 03:42:03.718427 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 280/565] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:03 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1739 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:04.049874 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-33941455-ffbb-4e67-9c79-6707f5b182c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:04.050904 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-33941455-ffbb-4e67-9c79-6707f5b182c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:04.066979 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-33941455-ffbb-4e67-9c79-6707f5b182c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:04.068099 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-33941455-ffbb-4e67-9c79-6707f5b182c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:04.069926 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-33941455-ffbb-4e67-9c79-6707f5b182c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:04.070610 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-33941455-ffbb-4e67-9c79-6707f5b182c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:04.399553 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-33941455-ffbb-4e67-9c79-6707f5b182c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:04.411756 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-33941455-ffbb-4e67-9c79-6707f5b182c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.365708 Aug 10 03:42:04.413465 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 286/566] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:04 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:04.572832 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-bff928cf-8f78-42c1-8ab2-a83dc1789da2 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:04.577905 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-bff928cf-8f78-42c1-8ab2-a83dc1789da2 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:04.590609 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bff928cf-8f78-42c1-8ab2-a83dc1789da2 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:04.591470 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bff928cf-8f78-42c1-8ab2-a83dc1789da2 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:04.592689 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bff928cf-8f78-42c1-8ab2-a83dc1789da2 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:04.593344 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bff928cf-8f78-42c1-8ab2-a83dc1789da2 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:04.736782 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c16cf361-9d92-49f8-8fa6-8b6b17d287a8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:04.742794 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c16cf361-9d92-49f8-8fa6-8b6b17d287a8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:04.752466 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c16cf361-9d92-49f8-8fa6-8b6b17d287a8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:04.755190 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c16cf361-9d92-49f8-8fa6-8b6b17d287a8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:04.757227 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c16cf361-9d92-49f8-8fa6-8b6b17d287a8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:04.758147 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c16cf361-9d92-49f8-8fa6-8b6b17d287a8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:04.902130 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-bff928cf-8f78-42c1-8ab2-a83dc1789da2 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:04.913919 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-bff928cf-8f78-42c1-8ab2-a83dc1789da2 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.345318 Aug 10 03:42:04.915082 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 281/567] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:04 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:04.929267 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-96fd6a70-7c2d-47e5-90e5-6aa0bc84517b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:04.931549 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-96fd6a70-7c2d-47e5-90e5-6aa0bc84517b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:04.948339 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-96fd6a70-7c2d-47e5-90e5-6aa0bc84517b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:04.955590 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-96fd6a70-7c2d-47e5-90e5-6aa0bc84517b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:04.957267 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-96fd6a70-7c2d-47e5-90e5-6aa0bc84517b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:04.957935 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-96fd6a70-7c2d-47e5-90e5-6aa0bc84517b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:05.000148 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c16cf361-9d92-49f8-8fa6-8b6b17d287a8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:05.009408 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c16cf361-9d92-49f8-8fa6-8b6b17d287a8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:05.012073 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c16cf361-9d92-49f8-8fa6-8b6b17d287a8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:05.013596 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c16cf361-9d92-49f8-8fa6-8b6b17d287a8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1739 microversion: 2.20 time: 0.300833 Aug 10 03:42:05.014376 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 287/568] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:04 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:05.206785 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-96fd6a70-7c2d-47e5-90e5-6aa0bc84517b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lazy-loading 'services' on Instance uuid b772114c-6e12-41fc-b52a-f9bec5125afc {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:42:05.433559 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0d7437a8-49db-4863-ba37-5b22f4341bbc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:05.434632 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0d7437a8-49db-4863-ba37-5b22f4341bbc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:05.449746 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0d7437a8-49db-4863-ba37-5b22f4341bbc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:05.450612 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0d7437a8-49db-4863-ba37-5b22f4341bbc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:05.452251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0d7437a8-49db-4863-ba37-5b22f4341bbc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:05.453161 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0d7437a8-49db-4863-ba37-5b22f4341bbc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:05.655774 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0d7437a8-49db-4863-ba37-5b22f4341bbc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:05.677358 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0d7437a8-49db-4863-ba37-5b22f4341bbc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.250225 Aug 10 03:42:05.679367 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 288/569] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:05 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:05.920850 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-96fd6a70-7c2d-47e5-90e5-6aa0bc84517b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc/os-volume_attachments/647e683c-a4b5-4345-9e61-7885a0305a1f" status: 202 len: 0 microversion: 2.1 time: 1.004120 Aug 10 03:42:05.922335 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 282/570] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 10 03:42:04 2021] DELETE /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc/os-volume_attachments/647e683c-a4b5-4345-9e61-7885a0305a1f => generated 0 bytes in 1007 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:42:05.931262 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-791ec243-9f34-4f34-a7d7-72a45a4e95ec tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:05.932311 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-791ec243-9f34-4f34-a7d7-72a45a4e95ec tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:05.942165 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-791ec243-9f34-4f34-a7d7-72a45a4e95ec tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:05.948044 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-791ec243-9f34-4f34-a7d7-72a45a4e95ec tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:05.948044 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-791ec243-9f34-4f34-a7d7-72a45a4e95ec tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:05.948044 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-791ec243-9f34-4f34-a7d7-72a45a4e95ec tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:05.948454 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3ce24d5c-e05b-4d01-8af3-16f28194b5e4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:05.949418 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3ce24d5c-e05b-4d01-8af3-16f28194b5e4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:05.964299 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3ce24d5c-e05b-4d01-8af3-16f28194b5e4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:05.965027 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3ce24d5c-e05b-4d01-8af3-16f28194b5e4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:05.968610 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3ce24d5c-e05b-4d01-8af3-16f28194b5e4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:05.969229 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3ce24d5c-e05b-4d01-8af3-16f28194b5e4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:06.011837 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-791ec243-9f34-4f34-a7d7-72a45a4e95ec tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084522 Aug 10 03:42:06.016715 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 289/571] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:42:05 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:42:06.043124 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-039e8371-e50e-4c84-8973-24d265692f2b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:06.043699 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-039e8371-e50e-4c84-8973-24d265692f2b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:06.075091 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-039e8371-e50e-4c84-8973-24d265692f2b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:06.075554 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-039e8371-e50e-4c84-8973-24d265692f2b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:06.076951 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-039e8371-e50e-4c84-8973-24d265692f2b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:06.077465 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-039e8371-e50e-4c84-8973-24d265692f2b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:06.210982 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3ce24d5c-e05b-4d01-8af3-16f28194b5e4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:06.222976 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3ce24d5c-e05b-4d01-8af3-16f28194b5e4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.284938 Aug 10 03:42:06.223891 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 283/572] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:05 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:06.276424 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-039e8371-e50e-4c84-8973-24d265692f2b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:06.285297 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-039e8371-e50e-4c84-8973-24d265692f2b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:06.290133 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-039e8371-e50e-4c84-8973-24d265692f2b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:06.290133 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-039e8371-e50e-4c84-8973-24d265692f2b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1739 microversion: 2.20 time: 0.255256 Aug 10 03:42:06.290133 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 290/573] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:06 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:06.706720 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4e93b4d4-1d76-4afc-b63c-50a794b82874 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:06.707366 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4e93b4d4-1d76-4afc-b63c-50a794b82874 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:06.713992 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4e93b4d4-1d76-4afc-b63c-50a794b82874 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:06.714622 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4e93b4d4-1d76-4afc-b63c-50a794b82874 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:06.715415 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4e93b4d4-1d76-4afc-b63c-50a794b82874 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:06.715858 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4e93b4d4-1d76-4afc-b63c-50a794b82874 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:06.868755 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-4e93b4d4-1d76-4afc-b63c-50a794b82874 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:06.879080 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4e93b4d4-1d76-4afc-b63c-50a794b82874 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.178531 Aug 10 03:42:06.879583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 284/574] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:06 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:07.030445 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-caccb2bb-c0cf-4b07-9729-a19782447e71 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:07.034824 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-caccb2bb-c0cf-4b07-9729-a19782447e71 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:07.042958 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-caccb2bb-c0cf-4b07-9729-a19782447e71 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:07.044342 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-caccb2bb-c0cf-4b07-9729-a19782447e71 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:07.046739 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-caccb2bb-c0cf-4b07-9729-a19782447e71 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:07.052027 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-caccb2bb-c0cf-4b07-9729-a19782447e71 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:07.094835 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-caccb2bb-c0cf-4b07-9729-a19782447e71 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073526 Aug 10 03:42:07.104360 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 291/575] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:42:07 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:42:07.247168 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1f7e48da-6371-4d0a-b790-1c6749ee1801 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:07.250478 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1f7e48da-6371-4d0a-b790-1c6749ee1801 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:07.274760 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1f7e48da-6371-4d0a-b790-1c6749ee1801 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:07.279349 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1f7e48da-6371-4d0a-b790-1c6749ee1801 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:07.283697 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1f7e48da-6371-4d0a-b790-1c6749ee1801 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:07.287934 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1f7e48da-6371-4d0a-b790-1c6749ee1801 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:07.350110 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-14551d11-0c89-40ac-a9ed-4ddece09fcd2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:07.350758 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-14551d11-0c89-40ac-a9ed-4ddece09fcd2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:07.370753 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-14551d11-0c89-40ac-a9ed-4ddece09fcd2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:07.376370 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-14551d11-0c89-40ac-a9ed-4ddece09fcd2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:07.376370 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-14551d11-0c89-40ac-a9ed-4ddece09fcd2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:07.376370 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-14551d11-0c89-40ac-a9ed-4ddece09fcd2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:07.571343 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1f7e48da-6371-4d0a-b790-1c6749ee1801 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:07.598065 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1f7e48da-6371-4d0a-b790-1c6749ee1801 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.360270 Aug 10 03:42:07.599010 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 285/576] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:07 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:07.673104 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-14551d11-0c89-40ac-a9ed-4ddece09fcd2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:07.682764 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-14551d11-0c89-40ac-a9ed-4ddece09fcd2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:07.684512 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-14551d11-0c89-40ac-a9ed-4ddece09fcd2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:07.685784 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-14551d11-0c89-40ac-a9ed-4ddece09fcd2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1739 microversion: 2.20 time: 0.339955 Aug 10 03:42:07.697660 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 292/577] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:07 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1739 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:07.896401 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-cb66edc6-aa10-46af-8949-534af5c0de8d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:07.897288 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-cb66edc6-aa10-46af-8949-534af5c0de8d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:07.904317 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb66edc6-aa10-46af-8949-534af5c0de8d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:07.904920 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb66edc6-aa10-46af-8949-534af5c0de8d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:07.905780 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb66edc6-aa10-46af-8949-534af5c0de8d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:07.906286 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb66edc6-aa10-46af-8949-534af5c0de8d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:08.041730 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-cb66edc6-aa10-46af-8949-534af5c0de8d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:08.050496 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-cb66edc6-aa10-46af-8949-534af5c0de8d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.158176 Aug 10 03:42:08.051056 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 286/578] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:07 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:08.116105 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-63761007-3d0c-4aad-9e05-7ac6d65a72ef tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:08.117740 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-63761007-3d0c-4aad-9e05-7ac6d65a72ef tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:08.127327 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-63761007-3d0c-4aad-9e05-7ac6d65a72ef tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:08.128083 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-63761007-3d0c-4aad-9e05-7ac6d65a72ef tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:08.129958 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-63761007-3d0c-4aad-9e05-7ac6d65a72ef tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:08.129958 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-63761007-3d0c-4aad-9e05-7ac6d65a72ef tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:08.163646 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-63761007-3d0c-4aad-9e05-7ac6d65a72ef tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052203 Aug 10 03:42:08.164263 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 293/579] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:42:08 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:42:08.624594 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-72f37c4d-84e8-42ea-acf6-0c7afe7afd52 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:08.625755 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-72f37c4d-84e8-42ea-acf6-0c7afe7afd52 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:08.632145 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72f37c4d-84e8-42ea-acf6-0c7afe7afd52 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:08.632816 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72f37c4d-84e8-42ea-acf6-0c7afe7afd52 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:08.633778 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72f37c4d-84e8-42ea-acf6-0c7afe7afd52 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:08.634393 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-72f37c4d-84e8-42ea-acf6-0c7afe7afd52 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:08.705576 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6bbf293d-394e-4a66-b5af-e5e3c044db46 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:08.706274 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6bbf293d-394e-4a66-b5af-e5e3c044db46 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:08.716781 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6bbf293d-394e-4a66-b5af-e5e3c044db46 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:08.718135 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6bbf293d-394e-4a66-b5af-e5e3c044db46 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:08.719975 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6bbf293d-394e-4a66-b5af-e5e3c044db46 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:08.720457 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6bbf293d-394e-4a66-b5af-e5e3c044db46 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:08.775951 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-72f37c4d-84e8-42ea-acf6-0c7afe7afd52 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:08.785197 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-72f37c4d-84e8-42ea-acf6-0c7afe7afd52 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.173628 Aug 10 03:42:08.785772 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 287/580] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:08 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:08.861059 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6bbf293d-394e-4a66-b5af-e5e3c044db46 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:08.869021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6bbf293d-394e-4a66-b5af-e5e3c044db46 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:08.870502 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6bbf293d-394e-4a66-b5af-e5e3c044db46 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:08.871626 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6bbf293d-394e-4a66-b5af-e5e3c044db46 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1721 microversion: 2.20 time: 0.170661 Aug 10 03:42:08.872184 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 294/581] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:08 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:09.067114 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-2f540313-294d-4c39-b9c6-275602556641 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:09.067634 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-2f540313-294d-4c39-b9c6-275602556641 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:09.073663 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2f540313-294d-4c39-b9c6-275602556641 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:09.074101 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2f540313-294d-4c39-b9c6-275602556641 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:09.074898 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2f540313-294d-4c39-b9c6-275602556641 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:09.075323 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2f540313-294d-4c39-b9c6-275602556641 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:09.199981 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-2f540313-294d-4c39-b9c6-275602556641 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:09.208171 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-2f540313-294d-4c39-b9c6-275602556641 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.145211 Aug 10 03:42:09.208756 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 288/582] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:09 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:09.802676 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-dd3cf706-167d-4679-a43e-a7e01b3d773c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:09.803322 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-dd3cf706-167d-4679-a43e-a7e01b3d773c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:09.809300 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dd3cf706-167d-4679-a43e-a7e01b3d773c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:09.809746 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dd3cf706-167d-4679-a43e-a7e01b3d773c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:09.810519 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dd3cf706-167d-4679-a43e-a7e01b3d773c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:09.811088 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dd3cf706-167d-4679-a43e-a7e01b3d773c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:09.892551 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6f67dd8f-1cb1-42cb-b5b9-3c8cbcf4e19d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:09.892551 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6f67dd8f-1cb1-42cb-b5b9-3c8cbcf4e19d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:09.900046 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6f67dd8f-1cb1-42cb-b5b9-3c8cbcf4e19d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:09.900529 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6f67dd8f-1cb1-42cb-b5b9-3c8cbcf4e19d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:09.901468 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6f67dd8f-1cb1-42cb-b5b9-3c8cbcf4e19d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:09.901826 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6f67dd8f-1cb1-42cb-b5b9-3c8cbcf4e19d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:09.943990 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-dd3cf706-167d-4679-a43e-a7e01b3d773c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:09.952578 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-dd3cf706-167d-4679-a43e-a7e01b3d773c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.153575 Aug 10 03:42:09.953142 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 295/583] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:09 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:10.032046 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6f67dd8f-1cb1-42cb-b5b9-3c8cbcf4e19d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:10.040055 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6f67dd8f-1cb1-42cb-b5b9-3c8cbcf4e19d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:10.041630 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6f67dd8f-1cb1-42cb-b5b9-3c8cbcf4e19d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:10.042806 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6f67dd8f-1cb1-42cb-b5b9-3c8cbcf4e19d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1721 microversion: 2.20 time: 0.155914 Aug 10 03:42:10.043349 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 289/584] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:09 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:10.225308 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b4a0810c-98bc-4984-89b4-296ce936d13d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:10.225930 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b4a0810c-98bc-4984-89b4-296ce936d13d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:10.231849 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b4a0810c-98bc-4984-89b4-296ce936d13d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:10.235403 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b4a0810c-98bc-4984-89b4-296ce936d13d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:10.235403 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b4a0810c-98bc-4984-89b4-296ce936d13d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:10.235403 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b4a0810c-98bc-4984-89b4-296ce936d13d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:10.355670 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b4a0810c-98bc-4984-89b4-296ce936d13d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:10.365327 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b4a0810c-98bc-4984-89b4-296ce936d13d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.143397 Aug 10 03:42:10.366209 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 296/585] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:10 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:10.969984 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7236871a-110e-48f5-a5bf-d378e81b4f6c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:10.970583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7236871a-110e-48f5-a5bf-d378e81b4f6c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:10.976510 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7236871a-110e-48f5-a5bf-d378e81b4f6c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:10.976952 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7236871a-110e-48f5-a5bf-d378e81b4f6c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:10.977719 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7236871a-110e-48f5-a5bf-d378e81b4f6c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:10.978147 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7236871a-110e-48f5-a5bf-d378e81b4f6c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:11.061706 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6cfe2230-b422-4f5a-a556-9f03d998e43c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:11.062311 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6cfe2230-b422-4f5a-a556-9f03d998e43c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:11.068342 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6cfe2230-b422-4f5a-a556-9f03d998e43c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:11.068843 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6cfe2230-b422-4f5a-a556-9f03d998e43c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:11.069613 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6cfe2230-b422-4f5a-a556-9f03d998e43c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:11.070113 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6cfe2230-b422-4f5a-a556-9f03d998e43c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:11.101001 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7236871a-110e-48f5-a5bf-d378e81b4f6c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:11.110292 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7236871a-110e-48f5-a5bf-d378e81b4f6c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1724 microversion: 2.1 time: 0.143663 Aug 10 03:42:11.110863 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 290/586] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:10 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:11.194277 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6cfe2230-b422-4f5a-a556-9f03d998e43c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:11.202588 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6cfe2230-b422-4f5a-a556-9f03d998e43c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:11.204068 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6cfe2230-b422-4f5a-a556-9f03d998e43c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:11.205219 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6cfe2230-b422-4f5a-a556-9f03d998e43c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1721 microversion: 2.20 time: 0.147785 Aug 10 03:42:11.205827 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 297/587] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:11 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:11.382204 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d59393d1-3cc4-4a07-b0d0-f5db60e11d56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:11.382808 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d59393d1-3cc4-4a07-b0d0-f5db60e11d56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:11.388817 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d59393d1-3cc4-4a07-b0d0-f5db60e11d56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:11.389260 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d59393d1-3cc4-4a07-b0d0-f5db60e11d56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:11.390021 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d59393d1-3cc4-4a07-b0d0-f5db60e11d56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:11.390447 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d59393d1-3cc4-4a07-b0d0-f5db60e11d56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:11.528039 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d59393d1-3cc4-4a07-b0d0-f5db60e11d56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:11.537590 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d59393d1-3cc4-4a07-b0d0-f5db60e11d56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.159076 Aug 10 03:42:11.538200 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 291/588] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:11 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:12.128177 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-4e8354c8-ed38-4e36-8c17-341a5049c7f7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:12.129434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-4e8354c8-ed38-4e36-8c17-341a5049c7f7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:12.135644 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4e8354c8-ed38-4e36-8c17-341a5049c7f7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:12.136266 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4e8354c8-ed38-4e36-8c17-341a5049c7f7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:12.137108 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4e8354c8-ed38-4e36-8c17-341a5049c7f7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:12.138206 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4e8354c8-ed38-4e36-8c17-341a5049c7f7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:12.223638 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-28bc14f6-ba94-4fec-b710-0ab36f26386b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:12.225868 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-28bc14f6-ba94-4fec-b710-0ab36f26386b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:12.230465 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-28bc14f6-ba94-4fec-b710-0ab36f26386b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:12.230913 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-28bc14f6-ba94-4fec-b710-0ab36f26386b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:12.231707 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-28bc14f6-ba94-4fec-b710-0ab36f26386b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:12.232132 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-28bc14f6-ba94-4fec-b710-0ab36f26386b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:12.287026 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4e8354c8-ed38-4e36-8c17-341a5049c7f7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:12.296083 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-4e8354c8-ed38-4e36-8c17-341a5049c7f7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1701 microversion: 2.1 time: 0.171239 Aug 10 03:42:12.297439 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 298/589] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:12 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1701 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:12.313117 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-990044d6-a2a9-4e5a-82b9-8d0c492b7834 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:12.318973 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-990044d6-a2a9-4e5a-82b9-8d0c492b7834 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:12.319561 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-990044d6-a2a9-4e5a-82b9-8d0c492b7834 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:12.421441 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-28bc14f6-ba94-4fec-b710-0ab36f26386b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:12.432381 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-28bc14f6-ba94-4fec-b710-0ab36f26386b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:12.434033 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-28bc14f6-ba94-4fec-b710-0ab36f26386b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:12.435299 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-28bc14f6-ba94-4fec-b710-0ab36f26386b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1721 microversion: 2.20 time: 0.215499 Aug 10 03:42:12.436315 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 292/590] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:12 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:12.436458 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-990044d6-a2a9-4e5a-82b9-8d0c492b7834 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Going to try to start instance {{(pid=108439) start /opt/stack/nova/nova/compute/api.py:2603}} Aug 10 03:42:12.509378 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-a4e6e6f8-1055-4649-ad6c-7f17f49ef253 req-b7d2c8d7-6701-44a6-939d-9df45f0abbeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c599984-f271-4886-be2f-73e7531f52e4", "name": "network-vif-unplugged", "status": "completed", "tag": "54a387d8-dbe0-4a78-bbba-58f771dd4478"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:12.511379 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:42:12.511379 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:42:12.521217 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-a4e6e6f8-1055-4649-ad6c-7f17f49ef253 req-b7d2c8d7-6701-44a6-939d-9df45f0abbeb service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:12.521217 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-a4e6e6f8-1055-4649-ad6c-7f17f49ef253 req-b7d2c8d7-6701-44a6-939d-9df45f0abbeb service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:12.534104 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-a4e6e6f8-1055-4649-ad6c-7f17f49ef253 req-b7d2c8d7-6701-44a6-939d-9df45f0abbeb service nova] Creating event network-vif-unplugged:54a387d8-dbe0-4a78-bbba-58f771dd4478 for instance 0c599984-f271-4886-be2f-73e7531f52e4 on hv-cinder-78239 Aug 10 03:42:12.540036 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-a4e6e6f8-1055-4649-ad6c-7f17f49ef253 req-b7d2c8d7-6701-44a6-939d-9df45f0abbeb service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035730 Aug 10 03:42:12.540690 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 293/591] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:42:12 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:42:12.556600 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-90d089b6-ec80-4901-b025-53752277f0c1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:12.557453 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-90d089b6-ec80-4901-b025-53752277f0c1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:12.565556 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-90d089b6-ec80-4901-b025-53752277f0c1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:12.566179 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-90d089b6-ec80-4901-b025-53752277f0c1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:12.572524 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-90d089b6-ec80-4901-b025-53752277f0c1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:12.572524 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-90d089b6-ec80-4901-b025-53752277f0c1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:12.669148 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-990044d6-a2a9-4e5a-82b9-8d0c492b7834 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 202 len: 0 microversion: 2.1 time: 0.359516 Aug 10 03:42:12.674798 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 299/592] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:42:12 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:42:12.689536 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-32f6e148-0b5b-4356-86c7-7db266385377 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:12.691066 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-32f6e148-0b5b-4356-86c7-7db266385377 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:12.698018 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-32f6e148-0b5b-4356-86c7-7db266385377 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:12.698675 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-32f6e148-0b5b-4356-86c7-7db266385377 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:12.699460 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-32f6e148-0b5b-4356-86c7-7db266385377 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:12.699892 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-32f6e148-0b5b-4356-86c7-7db266385377 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:12.761900 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-90d089b6-ec80-4901-b025-53752277f0c1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:12.795706 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-90d089b6-ec80-4901-b025-53752277f0c1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.239148 Aug 10 03:42:12.795706 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 294/593] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:12 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:12.844234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ff6c8165-b682-4f2d-a1aa-a88dfde95ac7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:12.845523 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ff6c8165-b682-4f2d-a1aa-a88dfde95ac7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:12.853572 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff6c8165-b682-4f2d-a1aa-a88dfde95ac7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:12.854181 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff6c8165-b682-4f2d-a1aa-a88dfde95ac7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:12.855857 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff6c8165-b682-4f2d-a1aa-a88dfde95ac7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:12.856332 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff6c8165-b682-4f2d-a1aa-a88dfde95ac7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:12.898915 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ff6c8165-b682-4f2d-a1aa-a88dfde95ac7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Going to try to terminate instance {{(pid=108440) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:42:12.989555 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-32f6e148-0b5b-4356-86c7-7db266385377 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:13.001009 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-32f6e148-0b5b-4356-86c7-7db266385377 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1710 microversion: 2.1 time: 0.317707 Aug 10 03:42:13.001618 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 300/594] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:12 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1710 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:13.386508 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ff6c8165-b682-4f2d-a1aa-a88dfde95ac7 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 204 len: 0 microversion: 2.1 time: 0.545048 Aug 10 03:42:13.391236 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 295/595] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:42:12 2021] DELETE /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 03:42:13.399368 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3df584df-1898-4412-a20c-bbd6e5d43bab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:13.400176 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3df584df-1898-4412-a20c-bbd6e5d43bab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:13.408413 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3df584df-1898-4412-a20c-bbd6e5d43bab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:13.409180 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3df584df-1898-4412-a20c-bbd6e5d43bab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:13.410953 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3df584df-1898-4412-a20c-bbd6e5d43bab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:13.411601 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3df584df-1898-4412-a20c-bbd6e5d43bab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:13.455159 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-dacb7562-a0c3-4024-b436-86a7c37e95f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:13.456186 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-dacb7562-a0c3-4024-b436-86a7c37e95f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:13.468678 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dacb7562-a0c3-4024-b436-86a7c37e95f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:13.469743 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dacb7562-a0c3-4024-b436-86a7c37e95f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:13.470822 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dacb7562-a0c3-4024-b436-86a7c37e95f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:13.472733 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dacb7562-a0c3-4024-b436-86a7c37e95f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:13.593273 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3df584df-1898-4412-a20c-bbd6e5d43bab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:13.603514 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3df584df-1898-4412-a20c-bbd6e5d43bab tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1514 microversion: 2.1 time: 0.208256 Aug 10 03:42:13.604393 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 301/596] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:13 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:13.744698 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-dacb7562-a0c3-4024-b436-86a7c37e95f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:13.750102 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-dacb7562-a0c3-4024-b436-86a7c37e95f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:13.751611 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-dacb7562-a0c3-4024-b436-86a7c37e95f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:13.752922 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-dacb7562-a0c3-4024-b436-86a7c37e95f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1721 microversion: 2.20 time: 0.301858 Aug 10 03:42:13.753769 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 296/597] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:13 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:13.810835 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-97a47a3f-5091-42b1-9baa-3fc997b81479 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:13.811900 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-97a47a3f-5091-42b1-9baa-3fc997b81479 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:13.836619 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-97a47a3f-5091-42b1-9baa-3fc997b81479 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:13.840934 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-97a47a3f-5091-42b1-9baa-3fc997b81479 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:13.842772 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-97a47a3f-5091-42b1-9baa-3fc997b81479 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:13.843425 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-97a47a3f-5091-42b1-9baa-3fc997b81479 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:14.022569 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a8a10924-28cc-4ddb-91c0-dddfa95381af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:14.035124 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a8a10924-28cc-4ddb-91c0-dddfa95381af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:14.077508 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a8a10924-28cc-4ddb-91c0-dddfa95381af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:14.087470 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a8a10924-28cc-4ddb-91c0-dddfa95381af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:14.087470 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a8a10924-28cc-4ddb-91c0-dddfa95381af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:14.088126 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a8a10924-28cc-4ddb-91c0-dddfa95381af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:14.090303 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-97a47a3f-5091-42b1-9baa-3fc997b81479 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:14.102873 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-97a47a3f-5091-42b1-9baa-3fc997b81479 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.295519 Aug 10 03:42:14.110545 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 302/598] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:13 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:14.488056 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a8a10924-28cc-4ddb-91c0-dddfa95381af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:14.497466 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a8a10924-28cc-4ddb-91c0-dddfa95381af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1710 microversion: 2.1 time: 0.481156 Aug 10 03:42:14.505296 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 297/599] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:14 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1710 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:14.620985 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6a83aff7-1c9a-4bb9-9153-c45c40d64e5e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:14.621729 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6a83aff7-1c9a-4bb9-9153-c45c40d64e5e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:14.630275 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6a83aff7-1c9a-4bb9-9153-c45c40d64e5e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:14.631817 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6a83aff7-1c9a-4bb9-9153-c45c40d64e5e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:14.631817 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6a83aff7-1c9a-4bb9-9153-c45c40d64e5e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:14.632284 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6a83aff7-1c9a-4bb9-9153-c45c40d64e5e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:14.771379 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e4dd35d6-8efc-422d-a433-5c8a1e5ef921 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:14.772039 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e4dd35d6-8efc-422d-a433-5c8a1e5ef921 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:14.777924 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e4dd35d6-8efc-422d-a433-5c8a1e5ef921 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:14.778359 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e4dd35d6-8efc-422d-a433-5c8a1e5ef921 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:14.779171 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e4dd35d6-8efc-422d-a433-5c8a1e5ef921 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:14.779640 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e4dd35d6-8efc-422d-a433-5c8a1e5ef921 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:14.790766 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6a83aff7-1c9a-4bb9-9153-c45c40d64e5e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:14.800308 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6a83aff7-1c9a-4bb9-9153-c45c40d64e5e tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1514 microversion: 2.1 time: 0.183206 Aug 10 03:42:14.801069 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 303/600] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:14 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:14.911446 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e4dd35d6-8efc-422d-a433-5c8a1e5ef921 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:14.919926 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e4dd35d6-8efc-422d-a433-5c8a1e5ef921 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:14.921621 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e4dd35d6-8efc-422d-a433-5c8a1e5ef921 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:14.922949 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e4dd35d6-8efc-422d-a433-5c8a1e5ef921 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1721 microversion: 2.20 time: 0.155683 Aug 10 03:42:14.923481 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 298/601] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:14 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:15.123998 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6e902662-74c3-4d7d-8806-045375d1a3b4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:15.124785 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6e902662-74c3-4d7d-8806-045375d1a3b4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:15.133375 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6e902662-74c3-4d7d-8806-045375d1a3b4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:15.133829 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6e902662-74c3-4d7d-8806-045375d1a3b4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:15.135002 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6e902662-74c3-4d7d-8806-045375d1a3b4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:15.135440 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6e902662-74c3-4d7d-8806-045375d1a3b4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:15.284085 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6e902662-74c3-4d7d-8806-045375d1a3b4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:15.292701 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6e902662-74c3-4d7d-8806-045375d1a3b4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.175715 Aug 10 03:42:15.298075 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 304/602] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:15 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:15.570291 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b5155fb7-8a70-40e4-b3cc-cf8c1dd8f9b8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:15.570996 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b5155fb7-8a70-40e4-b3cc-cf8c1dd8f9b8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:15.578942 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b5155fb7-8a70-40e4-b3cc-cf8c1dd8f9b8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:15.579900 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b5155fb7-8a70-40e4-b3cc-cf8c1dd8f9b8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:15.581392 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b5155fb7-8a70-40e4-b3cc-cf8c1dd8f9b8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:15.582076 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b5155fb7-8a70-40e4-b3cc-cf8c1dd8f9b8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:15.730439 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b5155fb7-8a70-40e4-b3cc-cf8c1dd8f9b8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:15.739300 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b5155fb7-8a70-40e4-b3cc-cf8c1dd8f9b8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1714 microversion: 2.1 time: 0.172980 Aug 10 03:42:15.750527 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 299/603] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:15 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1714 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:15.822687 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-cdb6e4fa-359d-4dba-9599-b614f0be6633 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:15.823264 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-cdb6e4fa-359d-4dba-9599-b614f0be6633 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:15.829752 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cdb6e4fa-359d-4dba-9599-b614f0be6633 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:15.830193 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cdb6e4fa-359d-4dba-9599-b614f0be6633 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:15.830966 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cdb6e4fa-359d-4dba-9599-b614f0be6633 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:15.831403 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cdb6e4fa-359d-4dba-9599-b614f0be6633 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:15.941974 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f307f494-14c4-4adf-b659-eab1f2819386 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:15.943085 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f307f494-14c4-4adf-b659-eab1f2819386 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:15.949636 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f307f494-14c4-4adf-b659-eab1f2819386 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:15.950316 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f307f494-14c4-4adf-b659-eab1f2819386 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:15.951280 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f307f494-14c4-4adf-b659-eab1f2819386 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:15.951853 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f307f494-14c4-4adf-b659-eab1f2819386 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:15.981042 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-cdb6e4fa-359d-4dba-9599-b614f0be6633 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:15.994677 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-cdb6e4fa-359d-4dba-9599-b614f0be6633 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1514 microversion: 2.1 time: 0.175615 Aug 10 03:42:15.995260 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 305/604] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:15 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:16.107146 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f307f494-14c4-4adf-b659-eab1f2819386 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:16.117026 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f307f494-14c4-4adf-b659-eab1f2819386 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:16.117264 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f307f494-14c4-4adf-b659-eab1f2819386 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:16.118395 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f307f494-14c4-4adf-b659-eab1f2819386 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1724 microversion: 2.20 time: 0.180300 Aug 10 03:42:16.118948 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 300/605] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:15 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:16.137012 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-57fc309b-73f0-45d2-80c7-2f7c28e9e70f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "944704e4-426c-4ad8-813f-591ae4b2e0a4"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:16.138145 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-57fc309b-73f0-45d2-80c7-2f7c28e9e70f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:16.144115 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-57fc309b-73f0-45d2-80c7-2f7c28e9e70f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:16.144851 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-57fc309b-73f0-45d2-80c7-2f7c28e9e70f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:16.145909 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-57fc309b-73f0-45d2-80c7-2f7c28e9e70f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:16.146333 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-57fc309b-73f0-45d2-80c7-2f7c28e9e70f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:16.310016 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-48aa656d-f811-4d4c-aa27-bedce7cbb41e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:16.312466 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-48aa656d-f811-4d4c-aa27-bedce7cbb41e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:16.316860 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-48aa656d-f811-4d4c-aa27-bedce7cbb41e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:16.317627 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-48aa656d-f811-4d4c-aa27-bedce7cbb41e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:16.318474 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-48aa656d-f811-4d4c-aa27-bedce7cbb41e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:16.318975 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-48aa656d-f811-4d4c-aa27-bedce7cbb41e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:16.531561 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-48aa656d-f811-4d4c-aa27-bedce7cbb41e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:16.540346 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-48aa656d-f811-4d4c-aa27-bedce7cbb41e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.233735 Aug 10 03:42:16.544464 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 301/606] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:16 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:16.986196 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-fa23b8ce-889f-4d73-8adf-390594e350d8 req-2739fa66-2cd8-4ffb-9e16-507064e3b819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b772114c-6e12-41fc-b52a-f9bec5125afc", "name": "network-vif-deleted", "tag": "089202fc-bf88-4e54-814b-80242a60ec09"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:16.988695 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:42:16.988695 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:42:17.005356 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-fa23b8ce-889f-4d73-8adf-390594e350d8 req-2739fa66-2cd8-4ffb-9e16-507064e3b819 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:17.005876 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-fa23b8ce-889f-4d73-8adf-390594e350d8 req-2739fa66-2cd8-4ffb-9e16-507064e3b819 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:17.030221 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-fa23b8ce-889f-4d73-8adf-390594e350d8 req-2739fa66-2cd8-4ffb-9e16-507064e3b819 service nova] Creating event network-vif-deleted:089202fc-bf88-4e54-814b-80242a60ec09 for instance b772114c-6e12-41fc-b52a-f9bec5125afc on hv-cinder-78239 Aug 10 03:42:17.038381 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-fa23b8ce-889f-4d73-8adf-390594e350d8 req-2739fa66-2cd8-4ffb-9e16-507064e3b819 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057642 Aug 10 03:42:17.046424 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 302/607] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:42:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:42:17.059055 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-246aca98-a889-4800-8125-c4816d60a756 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:17.059055 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-246aca98-a889-4800-8125-c4816d60a756 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:17.059749 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-246aca98-a889-4800-8125-c4816d60a756 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:17.060459 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-246aca98-a889-4800-8125-c4816d60a756 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:17.063598 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-246aca98-a889-4800-8125-c4816d60a756 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:17.064414 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-246aca98-a889-4800-8125-c4816d60a756 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:17.161753 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-246aca98-a889-4800-8125-c4816d60a756 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:17.169686 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-246aca98-a889-4800-8125-c4816d60a756 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1472 microversion: 2.1 time: 0.121951 Aug 10 03:42:17.171092 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 303/608] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:17 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1472 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:17.428671 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-57fc309b-73f0-45d2-80c7-2f7c28e9e70f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.295092 Aug 10 03:42:17.429963 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 306/609] 10.222.0.21 () {62 vars in 1364 bytes} [Tue Aug 10 03:42:16 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 188 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:42:17.558014 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c8e2d3e4-1545-41ae-ab28-7bb782010bbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:17.558523 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c8e2d3e4-1545-41ae-ab28-7bb782010bbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:17.566046 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c8e2d3e4-1545-41ae-ab28-7bb782010bbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:17.566490 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c8e2d3e4-1545-41ae-ab28-7bb782010bbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:17.567290 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c8e2d3e4-1545-41ae-ab28-7bb782010bbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:17.567897 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c8e2d3e4-1545-41ae-ab28-7bb782010bbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:17.585485 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8fb59806-ea97-4195-bdda-0969342abc8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:17.586045 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8fb59806-ea97-4195-bdda-0969342abc8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:17.592627 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8fb59806-ea97-4195-bdda-0969342abc8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:17.593064 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8fb59806-ea97-4195-bdda-0969342abc8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:17.593821 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8fb59806-ea97-4195-bdda-0969342abc8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:17.594244 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8fb59806-ea97-4195-bdda-0969342abc8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:17.714373 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c8e2d3e4-1545-41ae-ab28-7bb782010bbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:17.722201 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c8e2d3e4-1545-41ae-ab28-7bb782010bbe tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.168239 Aug 10 03:42:17.722752 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 304/610] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:17 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:17.916048 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8fb59806-ea97-4195-bdda-0969342abc8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action" status: 202 len: 0 microversion: 2.20 time: 0.334224 Aug 10 03:42:17.928741 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 307/611] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:42:17 2021] POST /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 03:42:17.928913 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-96b95b81-2302-4c81-9628-55165c0a95eb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:17.928913 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-96b95b81-2302-4c81-9628-55165c0a95eb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:17.933559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-96b95b81-2302-4c81-9628-55165c0a95eb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:17.934115 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-96b95b81-2302-4c81-9628-55165c0a95eb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:17.934834 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-96b95b81-2302-4c81-9628-55165c0a95eb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:17.935261 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-96b95b81-2302-4c81-9628-55165c0a95eb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:18.066434 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-96b95b81-2302-4c81-9628-55165c0a95eb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:18.075408 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-96b95b81-2302-4c81-9628-55165c0a95eb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:18.077881 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-96b95b81-2302-4c81-9628-55165c0a95eb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:18.079870 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-96b95b81-2302-4c81-9628-55165c0a95eb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1750 microversion: 2.20 time: 0.157356 Aug 10 03:42:18.080651 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 305/612] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:17 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:18.190204 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8ee93734-f156-4b32-8e78-34516631a07c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:18.190807 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8ee93734-f156-4b32-8e78-34516631a07c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:18.196735 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ee93734-f156-4b32-8e78-34516631a07c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:18.197228 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ee93734-f156-4b32-8e78-34516631a07c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:18.197992 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ee93734-f156-4b32-8e78-34516631a07c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:18.198418 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ee93734-f156-4b32-8e78-34516631a07c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:18.235465 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ee93734-f156-4b32-8e78-34516631a07c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:18.235913 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ee93734-f156-4b32-8e78-34516631a07c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:18.236421 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-8ee93734-f156-4b32-8e78-34516631a07c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lazy-loading 'fault' on Instance uuid b772114c-6e12-41fc-b52a-f9bec5125afc {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:42:18.282726 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8ee93734-f156-4b32-8e78-34516631a07c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:18.295279 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8ee93734-f156-4b32-8e78-34516631a07c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 200 len: 1308 microversion: 2.1 time: 0.108539 Aug 10 03:42:18.296680 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 308/613] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:18 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:18.739539 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6dee2ff3-0484-429d-a10b-87ab437d126d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:18.740336 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6dee2ff3-0484-429d-a10b-87ab437d126d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:18.746401 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6dee2ff3-0484-429d-a10b-87ab437d126d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:18.746837 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6dee2ff3-0484-429d-a10b-87ab437d126d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:18.747622 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6dee2ff3-0484-429d-a10b-87ab437d126d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:18.748144 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6dee2ff3-0484-429d-a10b-87ab437d126d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:18.877106 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6dee2ff3-0484-429d-a10b-87ab437d126d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:18.885528 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6dee2ff3-0484-429d-a10b-87ab437d126d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.149685 Aug 10 03:42:18.886310 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 306/614] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:18 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:19.098871 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-40bf5ffc-1b07-489a-8925-78681545ccca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:19.099667 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-40bf5ffc-1b07-489a-8925-78681545ccca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:19.106606 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-40bf5ffc-1b07-489a-8925-78681545ccca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:19.107333 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-40bf5ffc-1b07-489a-8925-78681545ccca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:19.109108 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-40bf5ffc-1b07-489a-8925-78681545ccca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:19.109792 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-40bf5ffc-1b07-489a-8925-78681545ccca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:19.233439 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-40bf5ffc-1b07-489a-8925-78681545ccca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:19.242058 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-40bf5ffc-1b07-489a-8925-78681545ccca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:19.243545 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-40bf5ffc-1b07-489a-8925-78681545ccca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:19.244716 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-40bf5ffc-1b07-489a-8925-78681545ccca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1750 microversion: 2.20 time: 0.149850 Aug 10 03:42:19.245263 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 309/615] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:19 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1750 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:19.313029 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-43d0a1ab-a6bb-4c7f-8335-a80e8f43b7f8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:19.313745 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-43d0a1ab-a6bb-4c7f-8335-a80e8f43b7f8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: b772114c-6e12-41fc-b52a-f9bec5125afc] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:19.319651 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43d0a1ab-a6bb-4c7f-8335-a80e8f43b7f8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:19.320098 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43d0a1ab-a6bb-4c7f-8335-a80e8f43b7f8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:19.320908 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43d0a1ab-a6bb-4c7f-8335-a80e8f43b7f8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:19.321571 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43d0a1ab-a6bb-4c7f-8335-a80e8f43b7f8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:19.337943 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-43d0a1ab-a6bb-4c7f-8335-a80e8f43b7f8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] HTTP exception thrown: Instance b772114c-6e12-41fc-b52a-f9bec5125afc could not be found. Aug 10 03:42:19.338793 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-43d0a1ab-a6bb-4c7f-8335-a80e8f43b7f8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Returning 404 to user: Instance b772114c-6e12-41fc-b52a-f9bec5125afc could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:42:19.339613 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-43d0a1ab-a6bb-4c7f-8335-a80e8f43b7f8 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc" status: 404 len: 111 microversion: 2.1 time: 0.030833 Aug 10 03:42:19.340160 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 307/616] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:19 2021] GET /compute/v2.1/servers/b772114c-6e12-41fc-b52a-f9bec5125afc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:42:19.902610 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9b284a4d-7fca-48d8-8e05-7f41703eecc1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:19.903224 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9b284a4d-7fca-48d8-8e05-7f41703eecc1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:19.909417 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9b284a4d-7fca-48d8-8e05-7f41703eecc1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:19.909858 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9b284a4d-7fca-48d8-8e05-7f41703eecc1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:19.910628 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9b284a4d-7fca-48d8-8e05-7f41703eecc1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:19.911122 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9b284a4d-7fca-48d8-8e05-7f41703eecc1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:20.039845 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-9b284a4d-7fca-48d8-8e05-7f41703eecc1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:20.049254 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9b284a4d-7fca-48d8-8e05-7f41703eecc1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.150286 Aug 10 03:42:20.052093 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 310/617] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:19 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:20.263336 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-375e098a-9033-4df3-83ea-0f249e315960 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:20.263965 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-375e098a-9033-4df3-83ea-0f249e315960 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:20.270560 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-375e098a-9033-4df3-83ea-0f249e315960 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:20.270997 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-375e098a-9033-4df3-83ea-0f249e315960 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:20.271775 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-375e098a-9033-4df3-83ea-0f249e315960 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:20.272226 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-375e098a-9033-4df3-83ea-0f249e315960 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:20.518013 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-375e098a-9033-4df3-83ea-0f249e315960 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:20.549043 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-375e098a-9033-4df3-83ea-0f249e315960 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:20.550999 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-375e098a-9033-4df3-83ea-0f249e315960 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:20.552422 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-375e098a-9033-4df3-83ea-0f249e315960 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1750 microversion: 2.20 time: 0.292983 Aug 10 03:42:20.564689 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 308/618] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:20 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1750 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:20.707881 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-66ba6440-e7d0-44c1-9e9a-8f10e9668aa1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:20.708837 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-66ba6440-e7d0-44c1-9e9a-8f10e9668aa1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:20.714883 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-66ba6440-e7d0-44c1-9e9a-8f10e9668aa1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:20.715397 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-66ba6440-e7d0-44c1-9e9a-8f10e9668aa1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:20.716243 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-66ba6440-e7d0-44c1-9e9a-8f10e9668aa1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:20.716827 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-66ba6440-e7d0-44c1-9e9a-8f10e9668aa1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:20.750586 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-66ba6440-e7d0-44c1-9e9a-8f10e9668aa1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Going to try to terminate instance {{(pid=108439) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:42:21.066396 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c989a09b-99ca-42b9-8fb4-72fee3afbe90 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:21.066922 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c989a09b-99ca-42b9-8fb4-72fee3afbe90 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:21.073121 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c989a09b-99ca-42b9-8fb4-72fee3afbe90 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:21.073817 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c989a09b-99ca-42b9-8fb4-72fee3afbe90 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:21.074825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c989a09b-99ca-42b9-8fb4-72fee3afbe90 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:21.075234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c989a09b-99ca-42b9-8fb4-72fee3afbe90 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:21.153876 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-66ba6440-e7d0-44c1-9e9a-8f10e9668aa1 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 204 len: 0 microversion: 2.1 time: 0.449988 Aug 10 03:42:21.158863 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 311/619] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:42:20 2021] DELETE /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:42:21.164093 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d27d1320-4ad4-4122-ab28-af8dadfe5dde tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:21.164858 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d27d1320-4ad4-4122-ab28-af8dadfe5dde tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:21.177079 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d27d1320-4ad4-4122-ab28-af8dadfe5dde tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:21.177836 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d27d1320-4ad4-4122-ab28-af8dadfe5dde tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:21.178789 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d27d1320-4ad4-4122-ab28-af8dadfe5dde tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:21.179371 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d27d1320-4ad4-4122-ab28-af8dadfe5dde tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:21.305952 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c989a09b-99ca-42b9-8fb4-72fee3afbe90 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:21.319194 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c989a09b-99ca-42b9-8fb4-72fee3afbe90 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.256412 Aug 10 03:42:21.319785 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 309/620] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:21 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:21.337131 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d27d1320-4ad4-4122-ab28-af8dadfe5dde tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:21.345980 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d27d1320-4ad4-4122-ab28-af8dadfe5dde tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1513 microversion: 2.1 time: 0.185766 Aug 10 03:42:21.356061 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 312/621] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:21 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:21.571022 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-234a3c7b-54b6-4be6-852c-eabbff33bda1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:21.574711 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-234a3c7b-54b6-4be6-852c-eabbff33bda1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:21.583315 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-234a3c7b-54b6-4be6-852c-eabbff33bda1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:21.583759 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-234a3c7b-54b6-4be6-852c-eabbff33bda1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:21.584756 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-234a3c7b-54b6-4be6-852c-eabbff33bda1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:21.585187 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-234a3c7b-54b6-4be6-852c-eabbff33bda1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:21.719593 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-234a3c7b-54b6-4be6-852c-eabbff33bda1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:21.729368 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-234a3c7b-54b6-4be6-852c-eabbff33bda1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:21.730876 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-234a3c7b-54b6-4be6-852c-eabbff33bda1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:21.732380 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-234a3c7b-54b6-4be6-852c-eabbff33bda1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1750 microversion: 2.20 time: 0.165124 Aug 10 03:42:21.733234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 310/622] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:21 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:22.336007 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9ef67aea-46de-425f-af99-c5f1e991ce56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:22.336601 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9ef67aea-46de-425f-af99-c5f1e991ce56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:22.343259 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9ef67aea-46de-425f-af99-c5f1e991ce56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:22.343706 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9ef67aea-46de-425f-af99-c5f1e991ce56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:22.344837 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9ef67aea-46de-425f-af99-c5f1e991ce56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:22.345017 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9ef67aea-46de-425f-af99-c5f1e991ce56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:22.363123 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-29f6dcd9-446a-48e7-b2a5-2c02601a0354 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:22.363988 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-29f6dcd9-446a-48e7-b2a5-2c02601a0354 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:22.370110 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-29f6dcd9-446a-48e7-b2a5-2c02601a0354 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:22.370772 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-29f6dcd9-446a-48e7-b2a5-2c02601a0354 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:22.371728 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-29f6dcd9-446a-48e7-b2a5-2c02601a0354 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:22.372350 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-29f6dcd9-446a-48e7-b2a5-2c02601a0354 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:22.482220 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-9ef67aea-46de-425f-af99-c5f1e991ce56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:22.490789 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9ef67aea-46de-425f-af99-c5f1e991ce56 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.158677 Aug 10 03:42:22.491316 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 313/623] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:22 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:22.523492 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-29f6dcd9-446a-48e7-b2a5-2c02601a0354 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:22.531412 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-29f6dcd9-446a-48e7-b2a5-2c02601a0354 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1513 microversion: 2.1 time: 0.172277 Aug 10 03:42:22.531974 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 311/624] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:22 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:22.750361 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-535ae40f-f856-4992-b815-00e82050d07a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:22.751229 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-535ae40f-f856-4992-b815-00e82050d07a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:22.756864 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-535ae40f-f856-4992-b815-00e82050d07a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:22.757307 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-535ae40f-f856-4992-b815-00e82050d07a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:22.758067 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-535ae40f-f856-4992-b815-00e82050d07a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:22.758495 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-535ae40f-f856-4992-b815-00e82050d07a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:22.886457 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-535ae40f-f856-4992-b815-00e82050d07a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:22.895955 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-535ae40f-f856-4992-b815-00e82050d07a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:22.897497 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-535ae40f-f856-4992-b815-00e82050d07a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:22.898639 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-535ae40f-f856-4992-b815-00e82050d07a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1750 microversion: 2.20 time: 0.152532 Aug 10 03:42:22.899353 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 314/625] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:22 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:23.507433 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8d04318b-b685-4a45-a282-84bdabaeda0f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:23.508048 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8d04318b-b685-4a45-a282-84bdabaeda0f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:23.514617 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8d04318b-b685-4a45-a282-84bdabaeda0f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:23.515063 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8d04318b-b685-4a45-a282-84bdabaeda0f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:23.515843 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8d04318b-b685-4a45-a282-84bdabaeda0f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:23.516304 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8d04318b-b685-4a45-a282-84bdabaeda0f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:23.547947 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-659f6590-71c3-4b95-9f62-03bf146f6238 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:23.549065 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-659f6590-71c3-4b95-9f62-03bf146f6238 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:23.555439 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-659f6590-71c3-4b95-9f62-03bf146f6238 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:23.555845 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-659f6590-71c3-4b95-9f62-03bf146f6238 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:23.556661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-659f6590-71c3-4b95-9f62-03bf146f6238 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:23.557106 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-659f6590-71c3-4b95-9f62-03bf146f6238 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:23.703607 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-659f6590-71c3-4b95-9f62-03bf146f6238 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:23.715115 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-659f6590-71c3-4b95-9f62-03bf146f6238 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1513 microversion: 2.1 time: 0.169010 Aug 10 03:42:23.715990 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 315/626] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:23 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:23.772614 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-8d04318b-b685-4a45-a282-84bdabaeda0f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:23.782427 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8d04318b-b685-4a45-a282-84bdabaeda0f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.278575 Aug 10 03:42:23.792236 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 312/627] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:23 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:23.917165 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3a86adf2-da2f-4b89-9bac-0fa407db7967 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:23.918122 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3a86adf2-da2f-4b89-9bac-0fa407db7967 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:23.924496 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a86adf2-da2f-4b89-9bac-0fa407db7967 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:23.925216 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a86adf2-da2f-4b89-9bac-0fa407db7967 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:23.926469 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a86adf2-da2f-4b89-9bac-0fa407db7967 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:23.927044 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a86adf2-da2f-4b89-9bac-0fa407db7967 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:24.076922 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-9bb67f6d-4ecd-4128-8799-4b5ca1acd955 req-72807f70-8451-4d79-b799-5c4a6c3fb208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f338fd01-6509-4b6f-815f-b6686013e38f", "name": "network-vif-deleted", "tag": "5766f816-81bb-4e8a-b365-c9a5595643b6"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:24.078443 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:42:24.078443 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:42:24.085898 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-9bb67f6d-4ecd-4128-8799-4b5ca1acd955 req-72807f70-8451-4d79-b799-5c4a6c3fb208 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:24.086733 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-9bb67f6d-4ecd-4128-8799-4b5ca1acd955 req-72807f70-8451-4d79-b799-5c4a6c3fb208 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:24.109260 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-9bb67f6d-4ecd-4128-8799-4b5ca1acd955 req-72807f70-8451-4d79-b799-5c4a6c3fb208 service nova] Creating event network-vif-deleted:5766f816-81bb-4e8a-b365-c9a5595643b6 for instance f338fd01-6509-4b6f-815f-b6686013e38f on hv-cinder-78239 Aug 10 03:42:24.109945 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3a86adf2-da2f-4b89-9bac-0fa407db7967 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:24.116626 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-9bb67f6d-4ecd-4128-8799-4b5ca1acd955 req-72807f70-8451-4d79-b799-5c4a6c3fb208 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043733 Aug 10 03:42:24.121339 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 313/628] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:42:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:42:24.122589 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3a86adf2-da2f-4b89-9bac-0fa407db7967 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:24.124754 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3a86adf2-da2f-4b89-9bac-0fa407db7967 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:24.127308 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3a86adf2-da2f-4b89-9bac-0fa407db7967 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1750 microversion: 2.20 time: 0.212672 Aug 10 03:42:24.128462 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 316/629] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:23 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1750 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:24.737684 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-55f5017f-6eea-4fa9-8167-0bf8685d71f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:24.738611 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-55f5017f-6eea-4fa9-8167-0bf8685d71f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:24.749860 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-55f5017f-6eea-4fa9-8167-0bf8685d71f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:24.750616 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-55f5017f-6eea-4fa9-8167-0bf8685d71f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:24.751413 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-55f5017f-6eea-4fa9-8167-0bf8685d71f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:24.751851 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-55f5017f-6eea-4fa9-8167-0bf8685d71f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:24.788525 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-55f5017f-6eea-4fa9-8167-0bf8685d71f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:24.789352 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-55f5017f-6eea-4fa9-8167-0bf8685d71f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:24.790008 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-55f5017f-6eea-4fa9-8167-0bf8685d71f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lazy-loading 'fault' on Instance uuid f338fd01-6509-4b6f-815f-b6686013e38f {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:42:24.800414 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-cc934d94-8fa5-45d8-9d03-bb283d69d4bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:24.801659 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-cc934d94-8fa5-45d8-9d03-bb283d69d4bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:24.810024 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cc934d94-8fa5-45d8-9d03-bb283d69d4bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:24.815901 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cc934d94-8fa5-45d8-9d03-bb283d69d4bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:24.816805 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cc934d94-8fa5-45d8-9d03-bb283d69d4bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:24.817565 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cc934d94-8fa5-45d8-9d03-bb283d69d4bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:24.877647 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-55f5017f-6eea-4fa9-8167-0bf8685d71f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:24.891435 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-55f5017f-6eea-4fa9-8167-0bf8685d71f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 200 len: 1307 microversion: 2.1 time: 0.161773 Aug 10 03:42:24.893230 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 314/630] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:24 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 1307 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:25.015553 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-cc934d94-8fa5-45d8-9d03-bb283d69d4bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:25.023957 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-cc934d94-8fa5-45d8-9d03-bb283d69d4bc tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.228663 Aug 10 03:42:25.037470 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 317/631] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:24 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:25.148567 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c3cb5c3b-b35b-4c6a-ba1d-1b480421915f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:25.158867 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c3cb5c3b-b35b-4c6a-ba1d-1b480421915f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:25.163407 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c3cb5c3b-b35b-4c6a-ba1d-1b480421915f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:25.164586 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c3cb5c3b-b35b-4c6a-ba1d-1b480421915f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:25.165773 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c3cb5c3b-b35b-4c6a-ba1d-1b480421915f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:25.166461 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c3cb5c3b-b35b-4c6a-ba1d-1b480421915f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:25.339214 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c3cb5c3b-b35b-4c6a-ba1d-1b480421915f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:25.351451 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c3cb5c3b-b35b-4c6a-ba1d-1b480421915f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:25.353621 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c3cb5c3b-b35b-4c6a-ba1d-1b480421915f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:25.354916 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c3cb5c3b-b35b-4c6a-ba1d-1b480421915f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1750 microversion: 2.20 time: 0.213030 Aug 10 03:42:25.355737 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 315/632] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:25 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1750 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:25.919406 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ec1c2181-d273-475a-b18f-b67d456ab2f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:25.921864 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ec1c2181-d273-475a-b18f-b67d456ab2f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f338fd01-6509-4b6f-815f-b6686013e38f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:25.929166 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ec1c2181-d273-475a-b18f-b67d456ab2f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:25.930009 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ec1c2181-d273-475a-b18f-b67d456ab2f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:25.931424 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ec1c2181-d273-475a-b18f-b67d456ab2f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:25.932071 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ec1c2181-d273-475a-b18f-b67d456ab2f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:25.947868 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-ec1c2181-d273-475a-b18f-b67d456ab2f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] HTTP exception thrown: Instance f338fd01-6509-4b6f-815f-b6686013e38f could not be found. Aug 10 03:42:25.948775 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ec1c2181-d273-475a-b18f-b67d456ab2f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Returning 404 to user: Instance f338fd01-6509-4b6f-815f-b6686013e38f could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:42:25.950074 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ec1c2181-d273-475a-b18f-b67d456ab2f5 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f" status: 404 len: 111 microversion: 2.1 time: 0.035035 Aug 10 03:42:25.950991 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 318/633] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:25 2021] GET /compute/v2.1/servers/f338fd01-6509-4b6f-815f-b6686013e38f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:42:25.959361 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4dc9f130-0362-4b05-8e44-a97cc9ba3477 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:25.960714 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4dc9f130-0362-4b05-8e44-a97cc9ba3477 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:25.968519 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4dc9f130-0362-4b05-8e44-a97cc9ba3477 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:25.968976 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4dc9f130-0362-4b05-8e44-a97cc9ba3477 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:25.970143 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4dc9f130-0362-4b05-8e44-a97cc9ba3477 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:25.970582 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4dc9f130-0362-4b05-8e44-a97cc9ba3477 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:26.002325 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4dc9f130-0362-4b05-8e44-a97cc9ba3477 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Going to try to terminate instance {{(pid=108440) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:42:26.043914 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-47507015-0a55-41c8-baaa-8210988966c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:26.045514 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-47507015-0a55-41c8-baaa-8210988966c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:26.053314 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47507015-0a55-41c8-baaa-8210988966c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:26.053772 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47507015-0a55-41c8-baaa-8210988966c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:26.054774 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47507015-0a55-41c8-baaa-8210988966c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:26.055188 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47507015-0a55-41c8-baaa-8210988966c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:26.216454 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-47507015-0a55-41c8-baaa-8210988966c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:26.224804 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-47507015-0a55-41c8-baaa-8210988966c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.185184 Aug 10 03:42:26.225484 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 319/634] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:26 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:26.374053 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d297851a-9b41-40a7-9bcd-b1e82622c393 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:26.374783 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d297851a-9b41-40a7-9bcd-b1e82622c393 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:26.381083 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d297851a-9b41-40a7-9bcd-b1e82622c393 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:26.381757 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d297851a-9b41-40a7-9bcd-b1e82622c393 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:26.382469 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4dc9f130-0362-4b05-8e44-a97cc9ba3477 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 204 len: 0 microversion: 2.1 time: 0.426744 Aug 10 03:42:26.382607 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d297851a-9b41-40a7-9bcd-b1e82622c393 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:26.383051 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d297851a-9b41-40a7-9bcd-b1e82622c393 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:26.386426 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 316/635] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:42:25 2021] DELETE /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:42:26.392771 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-caa774f1-66b6-4e1e-ae3d-575499b6ef27 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:26.395089 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-caa774f1-66b6-4e1e-ae3d-575499b6ef27 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:26.401771 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-caa774f1-66b6-4e1e-ae3d-575499b6ef27 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:26.402220 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-caa774f1-66b6-4e1e-ae3d-575499b6ef27 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:26.403005 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-caa774f1-66b6-4e1e-ae3d-575499b6ef27 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:26.403449 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-caa774f1-66b6-4e1e-ae3d-575499b6ef27 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:26.539380 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-caa774f1-66b6-4e1e-ae3d-575499b6ef27 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:26.547318 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d297851a-9b41-40a7-9bcd-b1e82622c393 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:26.548182 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-caa774f1-66b6-4e1e-ae3d-575499b6ef27 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1512 microversion: 2.1 time: 0.160356 Aug 10 03:42:26.556252 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 317/636] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:26 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:26.562027 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d297851a-9b41-40a7-9bcd-b1e82622c393 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:26.562027 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d297851a-9b41-40a7-9bcd-b1e82622c393 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:26.562027 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d297851a-9b41-40a7-9bcd-b1e82622c393 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1750 microversion: 2.20 time: 0.190557 Aug 10 03:42:26.562357 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 320/637] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:26 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1750 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:27.241798 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-713f1b68-e533-4f82-ae74-a8ca76ed177e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:27.243265 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-713f1b68-e533-4f82-ae74-a8ca76ed177e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:27.250277 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-713f1b68-e533-4f82-ae74-a8ca76ed177e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:27.250626 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-713f1b68-e533-4f82-ae74-a8ca76ed177e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:27.251416 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-713f1b68-e533-4f82-ae74-a8ca76ed177e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:27.251847 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-713f1b68-e533-4f82-ae74-a8ca76ed177e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:27.375616 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-713f1b68-e533-4f82-ae74-a8ca76ed177e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:27.383326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-713f1b68-e533-4f82-ae74-a8ca76ed177e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.145199 Aug 10 03:42:27.384051 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 318/638] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:27 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:27.565050 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-99edecea-437b-47dc-88ae-6ffa6f44280d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:27.565748 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-99edecea-437b-47dc-88ae-6ffa6f44280d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:27.571825 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-99edecea-437b-47dc-88ae-6ffa6f44280d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:27.572561 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-99edecea-437b-47dc-88ae-6ffa6f44280d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:27.573481 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-99edecea-437b-47dc-88ae-6ffa6f44280d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:27.574146 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-99edecea-437b-47dc-88ae-6ffa6f44280d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:27.581831 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-347b196d-4620-4a3e-becc-dedd568a750c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:27.582429 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-347b196d-4620-4a3e-becc-dedd568a750c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:27.588838 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-347b196d-4620-4a3e-becc-dedd568a750c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:27.589696 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-347b196d-4620-4a3e-becc-dedd568a750c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:27.590384 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-347b196d-4620-4a3e-becc-dedd568a750c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:27.591153 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-347b196d-4620-4a3e-becc-dedd568a750c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:27.722174 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-99edecea-437b-47dc-88ae-6ffa6f44280d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:27.732965 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-99edecea-437b-47dc-88ae-6ffa6f44280d tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1512 microversion: 2.1 time: 0.170782 Aug 10 03:42:27.734360 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 321/639] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:27 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:27.750809 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-347b196d-4620-4a3e-becc-dedd568a750c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:27.759572 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-347b196d-4620-4a3e-becc-dedd568a750c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:27.761172 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-347b196d-4620-4a3e-becc-dedd568a750c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:27.762359 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-347b196d-4620-4a3e-becc-dedd568a750c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1750 microversion: 2.20 time: 0.184892 Aug 10 03:42:27.762942 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 319/640] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:27 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:28.400602 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c0282d39-93e0-4261-bd3e-1f4f947cca25 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:28.401206 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c0282d39-93e0-4261-bd3e-1f4f947cca25 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:28.407656 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c0282d39-93e0-4261-bd3e-1f4f947cca25 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:28.408651 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c0282d39-93e0-4261-bd3e-1f4f947cca25 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:28.409425 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c0282d39-93e0-4261-bd3e-1f4f947cca25 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:28.409854 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c0282d39-93e0-4261-bd3e-1f4f947cca25 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:28.564791 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c0282d39-93e0-4261-bd3e-1f4f947cca25 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:28.573412 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c0282d39-93e0-4261-bd3e-1f4f947cca25 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.176354 Aug 10 03:42:28.574672 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 322/641] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:28 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:28.753844 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3ba2b3a2-a936-4c22-9a1b-e376b7fa1ccf tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:28.755603 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3ba2b3a2-a936-4c22-9a1b-e376b7fa1ccf tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:28.765289 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3ba2b3a2-a936-4c22-9a1b-e376b7fa1ccf tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:28.766758 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3ba2b3a2-a936-4c22-9a1b-e376b7fa1ccf tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:28.767670 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3ba2b3a2-a936-4c22-9a1b-e376b7fa1ccf tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:28.768246 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3ba2b3a2-a936-4c22-9a1b-e376b7fa1ccf tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:28.791915 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-dee150c0-bbed-4331-87a7-13b617dc54b1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:28.793342 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-dee150c0-bbed-4331-87a7-13b617dc54b1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:28.814415 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dee150c0-bbed-4331-87a7-13b617dc54b1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:28.815017 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dee150c0-bbed-4331-87a7-13b617dc54b1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:28.816829 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dee150c0-bbed-4331-87a7-13b617dc54b1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:28.821283 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dee150c0-bbed-4331-87a7-13b617dc54b1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:28.848606 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3ba2b3a2-a936-4c22-9a1b-e376b7fa1ccf tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:28.858293 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3ba2b3a2-a936-4c22-9a1b-e376b7fa1ccf tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1470 microversion: 2.1 time: 0.109136 Aug 10 03:42:28.858686 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 320/642] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:28 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1470 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:28.872446 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-0f50cb08-57c2-48ef-b8ba-4886d6b4e83c req-49760fbf-9ff8-4aa0-ab39-da92eceb35b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f213fc94-e730-4eb5-9e17-14f69627cc4f", "name": "network-vif-deleted", "tag": "f709d076-13f8-4646-b744-12a5c0e99aa7"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:28.877275 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:42:28.877275 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:42:28.882383 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-0f50cb08-57c2-48ef-b8ba-4886d6b4e83c req-49760fbf-9ff8-4aa0-ab39-da92eceb35b1 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:28.883096 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-0f50cb08-57c2-48ef-b8ba-4886d6b4e83c req-49760fbf-9ff8-4aa0-ab39-da92eceb35b1 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:28.895387 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-0f50cb08-57c2-48ef-b8ba-4886d6b4e83c req-49760fbf-9ff8-4aa0-ab39-da92eceb35b1 service nova] Creating event network-vif-deleted:f709d076-13f8-4646-b744-12a5c0e99aa7 for instance f213fc94-e730-4eb5-9e17-14f69627cc4f on hv-cinder-78239 Aug 10 03:42:28.901385 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-0f50cb08-57c2-48ef-b8ba-4886d6b4e83c req-49760fbf-9ff8-4aa0-ab39-da92eceb35b1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041140 Aug 10 03:42:28.902073 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 321/643] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:42:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:42:28.990388 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-dee150c0-bbed-4331-87a7-13b617dc54b1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:28.999318 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-dee150c0-bbed-4331-87a7-13b617dc54b1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:29.000845 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-dee150c0-bbed-4331-87a7-13b617dc54b1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:29.001985 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-dee150c0-bbed-4331-87a7-13b617dc54b1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1750 microversion: 2.20 time: 0.214924 Aug 10 03:42:29.002539 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 323/644] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:28 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1750 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:29.597124 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c6171cab-3505-4c11-8d2d-11779b4e572d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:29.597820 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c6171cab-3505-4c11-8d2d-11779b4e572d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:29.604115 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c6171cab-3505-4c11-8d2d-11779b4e572d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:29.604599 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c6171cab-3505-4c11-8d2d-11779b4e572d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:29.605366 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c6171cab-3505-4c11-8d2d-11779b4e572d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:29.605793 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c6171cab-3505-4c11-8d2d-11779b4e572d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:29.737921 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c6171cab-3505-4c11-8d2d-11779b4e572d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:29.750177 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c6171cab-3505-4c11-8d2d-11779b4e572d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1568 microversion: 2.1 time: 0.159084 Aug 10 03:42:29.750744 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 322/645] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:29 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:29.875014 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-38a1ceee-ff87-47f4-9f82-b59be3bbb97f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:29.875627 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-38a1ceee-ff87-47f4-9f82-b59be3bbb97f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:29.881661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-38a1ceee-ff87-47f4-9f82-b59be3bbb97f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:29.882064 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-38a1ceee-ff87-47f4-9f82-b59be3bbb97f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:29.883344 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-38a1ceee-ff87-47f4-9f82-b59be3bbb97f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:29.883545 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-38a1ceee-ff87-47f4-9f82-b59be3bbb97f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:29.921834 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-38a1ceee-ff87-47f4-9f82-b59be3bbb97f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:29.922277 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-38a1ceee-ff87-47f4-9f82-b59be3bbb97f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:29.922722 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-38a1ceee-ff87-47f4-9f82-b59be3bbb97f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lazy-loading 'fault' on Instance uuid f213fc94-e730-4eb5-9e17-14f69627cc4f {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:42:29.962811 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-38a1ceee-ff87-47f4-9f82-b59be3bbb97f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:29.970153 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-38a1ceee-ff87-47f4-9f82-b59be3bbb97f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 200 len: 1306 microversion: 2.1 time: 0.099372 Aug 10 03:42:29.970707 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 324/646] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:29 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 1306 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:30.020314 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-89d0ab6b-c8e2-4c91-8e9b-7060b7d43be8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:30.020923 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-89d0ab6b-c8e2-4c91-8e9b-7060b7d43be8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:30.026735 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-89d0ab6b-c8e2-4c91-8e9b-7060b7d43be8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:30.027173 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-89d0ab6b-c8e2-4c91-8e9b-7060b7d43be8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:30.027939 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-89d0ab6b-c8e2-4c91-8e9b-7060b7d43be8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:30.028401 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-89d0ab6b-c8e2-4c91-8e9b-7060b7d43be8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:30.167754 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-89d0ab6b-c8e2-4c91-8e9b-7060b7d43be8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:30.176045 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-89d0ab6b-c8e2-4c91-8e9b-7060b7d43be8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:30.177578 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-89d0ab6b-c8e2-4c91-8e9b-7060b7d43be8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:30.178712 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-89d0ab6b-c8e2-4c91-8e9b-7060b7d43be8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1752 microversion: 2.20 time: 0.162162 Aug 10 03:42:30.179423 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 323/647] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:30 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:30.767446 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-04cd73ee-849a-4ba4-9dd2-68e25ad86bf8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:30.768137 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-04cd73ee-849a-4ba4-9dd2-68e25ad86bf8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:30.783989 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-04cd73ee-849a-4ba4-9dd2-68e25ad86bf8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:30.784475 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-04cd73ee-849a-4ba4-9dd2-68e25ad86bf8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:30.785264 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-04cd73ee-849a-4ba4-9dd2-68e25ad86bf8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:30.785756 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-04cd73ee-849a-4ba4-9dd2-68e25ad86bf8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:30.915990 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-04cd73ee-849a-4ba4-9dd2-68e25ad86bf8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:30.929238 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-04cd73ee-849a-4ba4-9dd2-68e25ad86bf8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1548 microversion: 2.1 time: 0.161838 Aug 10 03:42:30.936779 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 325/648] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:30 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:30.942422 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-024394e9-9b74-4e05-9aaa-12fd14ddda19 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:30.943126 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-024394e9-9b74-4e05-9aaa-12fd14ddda19 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:30.949198 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-024394e9-9b74-4e05-9aaa-12fd14ddda19 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:30.949638 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-024394e9-9b74-4e05-9aaa-12fd14ddda19 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:30.950411 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-024394e9-9b74-4e05-9aaa-12fd14ddda19 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:30.951000 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-024394e9-9b74-4e05-9aaa-12fd14ddda19 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:30.987564 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-82657c10-f6a3-4d36-9ea2-d6f1dd23dd40 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:30.988284 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-82657c10-f6a3-4d36-9ea2-d6f1dd23dd40 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: f213fc94-e730-4eb5-9e17-14f69627cc4f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:30.997532 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-82657c10-f6a3-4d36-9ea2-d6f1dd23dd40 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:30.997532 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-82657c10-f6a3-4d36-9ea2-d6f1dd23dd40 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:30.997532 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-82657c10-f6a3-4d36-9ea2-d6f1dd23dd40 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:30.997532 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-82657c10-f6a3-4d36-9ea2-d6f1dd23dd40 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:31.011719 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-82657c10-f6a3-4d36-9ea2-d6f1dd23dd40 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] HTTP exception thrown: Instance f213fc94-e730-4eb5-9e17-14f69627cc4f could not be found. Aug 10 03:42:31.012217 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-82657c10-f6a3-4d36-9ea2-d6f1dd23dd40 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Returning 404 to user: Instance f213fc94-e730-4eb5-9e17-14f69627cc4f could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:42:31.013079 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-82657c10-f6a3-4d36-9ea2-d6f1dd23dd40 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f" status: 404 len: 111 microversion: 2.1 time: 0.029774 Aug 10 03:42:31.013808 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 326/649] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:30 2021] GET /compute/v2.1/servers/f213fc94-e730-4eb5-9e17-14f69627cc4f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 03:42:31.042907 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-024394e9-9b74-4e05-9aaa-12fd14ddda19 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] HTTP exception thrown: Cannot 'detach_volume' instance f2c37d94-d078-4e35-819d-2ca11fc5cb5f while it is in vm_state rescued Aug 10 03:42:31.043549 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-024394e9-9b74-4e05-9aaa-12fd14ddda19 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Returning 409 to user: Cannot 'detach_volume' instance f2c37d94-d078-4e35-819d-2ca11fc5cb5f while it is in vm_state rescued {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:42:31.044366 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-024394e9-9b74-4e05-9aaa-12fd14ddda19 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments/93916f10-f05b-432a-ac03-625b1adadb11" status: 409 len: 152 microversion: 2.1 time: 0.106010 Aug 10 03:42:31.045401 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 324/650] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 10 03:42:30 2021] DELETE /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments/93916f10-f05b-432a-ac03-625b1adadb11 => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 03:42:31.053821 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-31cf9cb7-a8df-4467-8bd0-d16f3db8dadd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:31.054349 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-31cf9cb7-a8df-4467-8bd0-d16f3db8dadd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:31.061265 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-31cf9cb7-a8df-4467-8bd0-d16f3db8dadd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:31.061754 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-31cf9cb7-a8df-4467-8bd0-d16f3db8dadd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:31.062521 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-31cf9cb7-a8df-4467-8bd0-d16f3db8dadd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:31.062945 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-31cf9cb7-a8df-4467-8bd0-d16f3db8dadd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:31.198560 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a137e557-529c-482b-a3ad-b410c5c3f58e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:31.199234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a137e557-529c-482b-a3ad-b410c5c3f58e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:31.205577 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a137e557-529c-482b-a3ad-b410c5c3f58e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:31.206019 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a137e557-529c-482b-a3ad-b410c5c3f58e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:31.206778 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a137e557-529c-482b-a3ad-b410c5c3f58e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:31.207207 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a137e557-529c-482b-a3ad-b410c5c3f58e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:31.273314 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-31cf9cb7-a8df-4467-8bd0-d16f3db8dadd tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "POST /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/action" status: 202 len: 0 microversion: 2.1 time: 0.222912 Aug 10 03:42:31.274391 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 327/651] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:42:31 2021] POST /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:42:31.293811 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-257dd0be-44cd-4336-ab66-26f71dabf18c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:31.295410 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-257dd0be-44cd-4336-ab66-26f71dabf18c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:31.302398 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-257dd0be-44cd-4336-ab66-26f71dabf18c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:31.302922 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-257dd0be-44cd-4336-ab66-26f71dabf18c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:31.303770 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-257dd0be-44cd-4336-ab66-26f71dabf18c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:31.304393 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-257dd0be-44cd-4336-ab66-26f71dabf18c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:31.358168 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a137e557-529c-482b-a3ad-b410c5c3f58e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:31.367882 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a137e557-529c-482b-a3ad-b410c5c3f58e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:31.369472 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a137e557-529c-482b-a3ad-b410c5c3f58e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:31.370614 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a137e557-529c-482b-a3ad-b410c5c3f58e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1752 microversion: 2.20 time: 0.175717 Aug 10 03:42:31.371166 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 325/652] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:31 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:31.434750 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-257dd0be-44cd-4336-ab66-26f71dabf18c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:31.444711 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-257dd0be-44cd-4336-ab66-26f71dabf18c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1556 microversion: 2.1 time: 0.157820 Aug 10 03:42:31.446877 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 328/653] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:31 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:32.335116 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-2e2d7a63-de2a-45f1-93d1-9c56c0b02d25 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:32.335612 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-2e2d7a63-de2a-45f1-93d1-9c56c0b02d25 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:32.341572 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2e2d7a63-de2a-45f1-93d1-9c56c0b02d25 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:32.342146 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2e2d7a63-de2a-45f1-93d1-9c56c0b02d25 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:32.342891 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2e2d7a63-de2a-45f1-93d1-9c56c0b02d25 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:32.343313 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2e2d7a63-de2a-45f1-93d1-9c56c0b02d25 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:32.368499 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-2e2d7a63-de2a-45f1-93d1-9c56c0b02d25 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Going to try to terminate instance {{(pid=108440) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:42:32.389459 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c6a24ede-cd7c-4206-a8c6-2db8915e2e5b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:32.390359 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c6a24ede-cd7c-4206-a8c6-2db8915e2e5b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:32.401054 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c6a24ede-cd7c-4206-a8c6-2db8915e2e5b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:32.401501 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c6a24ede-cd7c-4206-a8c6-2db8915e2e5b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:32.402477 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c6a24ede-cd7c-4206-a8c6-2db8915e2e5b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:32.402900 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c6a24ede-cd7c-4206-a8c6-2db8915e2e5b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:32.538478 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c6a24ede-cd7c-4206-a8c6-2db8915e2e5b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:32.547348 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c6a24ede-cd7c-4206-a8c6-2db8915e2e5b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:32.548932 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c6a24ede-cd7c-4206-a8c6-2db8915e2e5b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:32.550227 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c6a24ede-cd7c-4206-a8c6-2db8915e2e5b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.165028 Aug 10 03:42:32.553500 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 329/654] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:32 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:32.555156 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b702d3a9-8a88-4661-afd7-d769ffe6d9d9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:32.555746 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b702d3a9-8a88-4661-afd7-d769ffe6d9d9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:32.561475 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b702d3a9-8a88-4661-afd7-d769ffe6d9d9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:32.561896 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b702d3a9-8a88-4661-afd7-d769ffe6d9d9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:32.562676 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b702d3a9-8a88-4661-afd7-d769ffe6d9d9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:32.563104 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b702d3a9-8a88-4661-afd7-d769ffe6d9d9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:32.709328 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b702d3a9-8a88-4661-afd7-d769ffe6d9d9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:32.721641 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b702d3a9-8a88-4661-afd7-d769ffe6d9d9 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1556 microversion: 2.1 time: 0.169414 Aug 10 03:42:32.722205 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 330/655] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:32 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:32.862617 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-2e2d7a63-de2a-45f1-93d1-9c56c0b02d25 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 204 len: 0 microversion: 2.1 time: 0.530725 Aug 10 03:42:32.863198 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 326/656] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:42:32 2021] DELETE /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:42:32.870897 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-48ed0001-b1f4-48dc-80ee-19c30668034b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:32.871533 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-48ed0001-b1f4-48dc-80ee-19c30668034b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:32.878315 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-48ed0001-b1f4-48dc-80ee-19c30668034b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:32.878765 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-48ed0001-b1f4-48dc-80ee-19c30668034b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:32.879523 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-48ed0001-b1f4-48dc-80ee-19c30668034b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:32.879951 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-48ed0001-b1f4-48dc-80ee-19c30668034b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:33.012059 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-48ed0001-b1f4-48dc-80ee-19c30668034b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:33.019963 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-48ed0001-b1f4-48dc-80ee-19c30668034b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1513 microversion: 2.1 time: 0.152739 Aug 10 03:42:33.020560 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 331/657] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:32 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:33.568791 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-00e6ad3a-e81f-4c2e-9106-e4aeb14d7b49 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:33.569592 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-00e6ad3a-e81f-4c2e-9106-e4aeb14d7b49 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:33.576888 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-00e6ad3a-e81f-4c2e-9106-e4aeb14d7b49 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:33.577813 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-00e6ad3a-e81f-4c2e-9106-e4aeb14d7b49 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:33.578816 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-00e6ad3a-e81f-4c2e-9106-e4aeb14d7b49 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:33.579414 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-00e6ad3a-e81f-4c2e-9106-e4aeb14d7b49 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:33.746165 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-cc804a2f-6690-485b-970c-64524e1bcce7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:33.746971 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-cc804a2f-6690-485b-970c-64524e1bcce7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:33.760375 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cc804a2f-6690-485b-970c-64524e1bcce7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:33.761437 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cc804a2f-6690-485b-970c-64524e1bcce7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:33.762248 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cc804a2f-6690-485b-970c-64524e1bcce7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:33.762684 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cc804a2f-6690-485b-970c-64524e1bcce7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:33.771978 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-00e6ad3a-e81f-4c2e-9106-e4aeb14d7b49 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:33.787532 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-00e6ad3a-e81f-4c2e-9106-e4aeb14d7b49 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:33.789767 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-00e6ad3a-e81f-4c2e-9106-e4aeb14d7b49 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:33.791460 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-00e6ad3a-e81f-4c2e-9106-e4aeb14d7b49 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.226729 Aug 10 03:42:33.804052 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 327/658] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:33 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:33.963207 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-cc804a2f-6690-485b-970c-64524e1bcce7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:33.977035 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-cc804a2f-6690-485b-970c-64524e1bcce7 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1556 microversion: 2.1 time: 0.235372 Aug 10 03:42:33.977597 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 332/659] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:33 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1556 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:34.036331 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d94dccb1-d43e-4f00-8414-cfaa83ff9b32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:34.037280 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d94dccb1-d43e-4f00-8414-cfaa83ff9b32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:34.043298 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d94dccb1-d43e-4f00-8414-cfaa83ff9b32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:34.043738 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d94dccb1-d43e-4f00-8414-cfaa83ff9b32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:34.044566 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d94dccb1-d43e-4f00-8414-cfaa83ff9b32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:34.045002 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d94dccb1-d43e-4f00-8414-cfaa83ff9b32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:34.176921 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d94dccb1-d43e-4f00-8414-cfaa83ff9b32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:34.184650 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d94dccb1-d43e-4f00-8414-cfaa83ff9b32 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1513 microversion: 2.1 time: 0.151958 Aug 10 03:42:34.185270 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 328/660] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:34 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:34.812371 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d60dde59-a96e-45c0-93b6-270b7eefec4d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:34.816100 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d60dde59-a96e-45c0-93b6-270b7eefec4d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:34.822658 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d60dde59-a96e-45c0-93b6-270b7eefec4d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:34.823108 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d60dde59-a96e-45c0-93b6-270b7eefec4d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:34.823889 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d60dde59-a96e-45c0-93b6-270b7eefec4d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:34.824359 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d60dde59-a96e-45c0-93b6-270b7eefec4d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:34.981823 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d60dde59-a96e-45c0-93b6-270b7eefec4d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:34.994277 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e7675a2d-7778-4078-bef8-b1fce8a7f791 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:34.995032 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e7675a2d-7778-4078-bef8-b1fce8a7f791 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:35.001881 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e7675a2d-7778-4078-bef8-b1fce8a7f791 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:35.002378 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e7675a2d-7778-4078-bef8-b1fce8a7f791 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:35.003166 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e7675a2d-7778-4078-bef8-b1fce8a7f791 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:35.003372 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d60dde59-a96e-45c0-93b6-270b7eefec4d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:35.003599 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e7675a2d-7778-4078-bef8-b1fce8a7f791 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:35.005951 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d60dde59-a96e-45c0-93b6-270b7eefec4d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:35.007339 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d60dde59-a96e-45c0-93b6-270b7eefec4d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.199850 Aug 10 03:42:35.007983 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 333/661] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:34 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:35.173819 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e7675a2d-7778-4078-bef8-b1fce8a7f791 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:35.190457 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e7675a2d-7778-4078-bef8-b1fce8a7f791 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1556 microversion: 2.1 time: 0.199928 Aug 10 03:42:35.191034 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 329/662] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:34 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1556 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:35.203661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ad8f7537-d928-48c3-a267-ae66779fe913 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:35.204723 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ad8f7537-d928-48c3-a267-ae66779fe913 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:35.215413 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ad8f7537-d928-48c3-a267-ae66779fe913 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:35.216059 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ad8f7537-d928-48c3-a267-ae66779fe913 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:35.217122 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ad8f7537-d928-48c3-a267-ae66779fe913 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:35.217630 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ad8f7537-d928-48c3-a267-ae66779fe913 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:35.371237 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ad8f7537-d928-48c3-a267-ae66779fe913 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:35.380219 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ad8f7537-d928-48c3-a267-ae66779fe913 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1513 microversion: 2.1 time: 0.182410 Aug 10 03:42:35.380800 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 334/663] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:35 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:36.026011 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ecef3a5c-9f2d-4159-aba7-d49ebe8b3ead tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:36.026615 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ecef3a5c-9f2d-4159-aba7-d49ebe8b3ead tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:36.032560 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ecef3a5c-9f2d-4159-aba7-d49ebe8b3ead tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:36.033187 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ecef3a5c-9f2d-4159-aba7-d49ebe8b3ead tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:36.034035 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ecef3a5c-9f2d-4159-aba7-d49ebe8b3ead tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:36.034463 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ecef3a5c-9f2d-4159-aba7-d49ebe8b3ead tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:36.202990 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ecef3a5c-9f2d-4159-aba7-d49ebe8b3ead tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:36.208978 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-30fbd438-27f0-44ed-b43a-f16cde91c956 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:36.209614 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-30fbd438-27f0-44ed-b43a-f16cde91c956 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:36.217901 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-30fbd438-27f0-44ed-b43a-f16cde91c956 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:36.218533 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-30fbd438-27f0-44ed-b43a-f16cde91c956 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:36.219051 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-30fbd438-27f0-44ed-b43a-f16cde91c956 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:36.219654 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-30fbd438-27f0-44ed-b43a-f16cde91c956 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:36.226769 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ecef3a5c-9f2d-4159-aba7-d49ebe8b3ead tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:36.228366 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ecef3a5c-9f2d-4159-aba7-d49ebe8b3ead tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:36.229521 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ecef3a5c-9f2d-4159-aba7-d49ebe8b3ead tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.207438 Aug 10 03:42:36.230083 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 330/664] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:36 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:36.361583 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-30fbd438-27f0-44ed-b43a-f16cde91c956 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:36.370820 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-30fbd438-27f0-44ed-b43a-f16cde91c956 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1556 microversion: 2.1 time: 0.165370 Aug 10 03:42:36.371398 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 335/665] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:36 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:36.403071 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-bb70437d-36c1-4cac-ae9a-c68790310a0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:36.403776 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-bb70437d-36c1-4cac-ae9a-c68790310a0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:36.409935 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bb70437d-36c1-4cac-ae9a-c68790310a0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:36.410702 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bb70437d-36c1-4cac-ae9a-c68790310a0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:36.411769 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bb70437d-36c1-4cac-ae9a-c68790310a0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:36.413169 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bb70437d-36c1-4cac-ae9a-c68790310a0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:36.561347 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-bb70437d-36c1-4cac-ae9a-c68790310a0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:36.570062 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-bb70437d-36c1-4cac-ae9a-c68790310a0b tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1513 microversion: 2.1 time: 0.170673 Aug 10 03:42:36.570743 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 331/666] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:36 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:36.596035 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1779178040", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1117142228", "security_groups": [{"name": "tempest-secgroup-smoke-4033915"}], "networks": [{"uuid": "0559be58-84b2-4cd0-a186-679ac0aab251"}], "block_device_mapping_v2": [{"uuid": "c8a2fcfd-613b-470d-ad0f-a39b9df01475", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:36.719284 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.network.neutron [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] validate_networks() for [('0559be58-84b2-4cd0-a186-679ac0aab251', None, None, None)] {{(pid=108439) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:42:37.192587 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Flavor limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:42:37.193629 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Image limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:42:37.194521 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Flavor pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:42:37.195121 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Image pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:42:37.195751 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:42:37.224952 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:37.230850 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:37.230850 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:37.230850 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:37.249361 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-300eba9d-66f1-4474-9144-276f28bc55d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:37.250620 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-300eba9d-66f1-4474-9144-276f28bc55d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:37.258082 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-300eba9d-66f1-4474-9144-276f28bc55d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:37.259252 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-300eba9d-66f1-4474-9144-276f28bc55d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:37.259252 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-300eba9d-66f1-4474-9144-276f28bc55d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:37.259725 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-300eba9d-66f1-4474-9144-276f28bc55d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:37.283452 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Getting quotas for project 77aab94ffcab4a8b9ad529c5a5454ae9. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:42:37.291116 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Getting quotas for user f35d508678b14f2583abf9ba5ae7fb91 and project 77aab94ffcab4a8b9ad529c5a5454ae9. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:42:37.389748 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Going to run 1 instances... {{(pid=108439) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:42:37.392170 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8a2fcfd-613b-470d-ad0f-a39b9df01475',volume_size=None,volume_type=None)] {{(pid=108439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:42:37.761818 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-300eba9d-66f1-4474-9144-276f28bc55d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:37.772092 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-300eba9d-66f1-4474-9144-276f28bc55d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:37.774045 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-300eba9d-66f1-4474-9144-276f28bc55d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:37.775556 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-300eba9d-66f1-4474-9144-276f28bc55d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.530258 Aug 10 03:42:37.787414 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 332/667] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:37 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:37.792818 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6b23fb7d-e75e-43ed-bdac-73b8e8e1bc81 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:37.797209 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6b23fb7d-e75e-43ed-bdac-73b8e8e1bc81 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:37.800814 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6b23fb7d-e75e-43ed-bdac-73b8e8e1bc81 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:37.801496 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6b23fb7d-e75e-43ed-bdac-73b8e8e1bc81 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:37.802486 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6b23fb7d-e75e-43ed-bdac-73b8e8e1bc81 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:37.803073 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6b23fb7d-e75e-43ed-bdac-73b8e8e1bc81 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:37.957873 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6b23fb7d-e75e-43ed-bdac-73b8e8e1bc81 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:37.966116 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6b23fb7d-e75e-43ed-bdac-73b8e8e1bc81 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1556 microversion: 2.1 time: 0.177159 Aug 10 03:42:37.966729 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 333/668] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:37 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:37.971511 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a9582eca-9c13-4214-a44c-d67279b9e919 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:37.972410 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a9582eca-9c13-4214-a44c-d67279b9e919 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:37.978834 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a9582eca-9c13-4214-a44c-d67279b9e919 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:37.979277 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a9582eca-9c13-4214-a44c-d67279b9e919 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:37.980160 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a9582eca-9c13-4214-a44c-d67279b9e919 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:37.980617 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a9582eca-9c13-4214-a44c-d67279b9e919 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:38.156364 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a9582eca-9c13-4214-a44c-d67279b9e919 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:38.165078 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a9582eca-9c13-4214-a44c-d67279b9e919 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1513 microversion: 2.1 time: 0.197146 Aug 10 03:42:38.166316 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 334/669] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:37 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:38.225735 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d2808535-1a74-45b5-8778-3e7c680163f5 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.647349 Aug 10 03:42:38.236962 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a6dc7231-545e-4f46-89b8-acbdfe36788f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:38.237582 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a6dc7231-545e-4f46-89b8-acbdfe36788f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:38.240536 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 336/670] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:42:36 2021] POST /compute/v2.1/servers => generated 403 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 03:42:38.294676 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a6dc7231-545e-4f46-89b8-acbdfe36788f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:38.302676 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a6dc7231-545e-4f46-89b8-acbdfe36788f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1089 microversion: 2.1 time: 0.069587 Aug 10 03:42:38.303502 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 335/671] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:38 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:38.795829 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-811b1468-8a9f-4a92-b8f5-01b4cb98fae0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:38.796465 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-811b1468-8a9f-4a92-b8f5-01b4cb98fae0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:38.802691 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-811b1468-8a9f-4a92-b8f5-01b4cb98fae0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:38.803394 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-811b1468-8a9f-4a92-b8f5-01b4cb98fae0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:38.809627 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-811b1468-8a9f-4a92-b8f5-01b4cb98fae0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:38.810474 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-811b1468-8a9f-4a92-b8f5-01b4cb98fae0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:38.988133 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-01b222fd-addc-4a64-9868-84c25268c1a1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:38.989175 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-01b222fd-addc-4a64-9868-84c25268c1a1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:39.006590 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-811b1468-8a9f-4a92-b8f5-01b4cb98fae0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:39.008260 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-01b222fd-addc-4a64-9868-84c25268c1a1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:39.008888 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-01b222fd-addc-4a64-9868-84c25268c1a1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:39.009832 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-01b222fd-addc-4a64-9868-84c25268c1a1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:39.011138 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-01b222fd-addc-4a64-9868-84c25268c1a1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:39.015709 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-811b1468-8a9f-4a92-b8f5-01b4cb98fae0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:39.017260 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-811b1468-8a9f-4a92-b8f5-01b4cb98fae0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:39.018438 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-811b1468-8a9f-4a92-b8f5-01b4cb98fae0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.227367 Aug 10 03:42:39.018992 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 337/672] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:38 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:39.179237 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-01b222fd-addc-4a64-9868-84c25268c1a1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:39.182196 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ba0152f6-6cd7-4546-9530-ec13e46d070a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:39.182874 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ba0152f6-6cd7-4546-9530-ec13e46d070a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:39.189347 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ba0152f6-6cd7-4546-9530-ec13e46d070a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:39.189578 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-01b222fd-addc-4a64-9868-84c25268c1a1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1556 microversion: 2.1 time: 0.207408 Aug 10 03:42:39.190153 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ba0152f6-6cd7-4546-9530-ec13e46d070a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:39.190290 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 336/673] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:38 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1556 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:39.191247 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ba0152f6-6cd7-4546-9530-ec13e46d070a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:39.191781 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ba0152f6-6cd7-4546-9530-ec13e46d070a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:39.319811 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7c492e3a-0510-445d-948c-cc683b432d51 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:39.320687 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7c492e3a-0510-445d-948c-cc683b432d51 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:39.335578 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ba0152f6-6cd7-4546-9530-ec13e46d070a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:39.347164 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ba0152f6-6cd7-4546-9530-ec13e46d070a tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1513 microversion: 2.1 time: 0.168561 Aug 10 03:42:39.348010 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 338/674] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:39 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:39.402583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7c492e3a-0510-445d-948c-cc683b432d51 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:39.402583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7c492e3a-0510-445d-948c-cc683b432d51 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1089 microversion: 2.1 time: 0.078264 Aug 10 03:42:39.402583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 337/675] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:39 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:40.036512 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-4c900972-3952-4150-8c6b-abd6ecb25024 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:40.037384 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-4c900972-3952-4150-8c6b-abd6ecb25024 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:40.044985 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4c900972-3952-4150-8c6b-abd6ecb25024 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:40.046177 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4c900972-3952-4150-8c6b-abd6ecb25024 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:40.047425 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4c900972-3952-4150-8c6b-abd6ecb25024 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:40.048096 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4c900972-3952-4150-8c6b-abd6ecb25024 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:40.238162 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4c900972-3952-4150-8c6b-abd6ecb25024 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:40.238162 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4c900972-3952-4150-8c6b-abd6ecb25024 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:40.238384 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4c900972-3952-4150-8c6b-abd6ecb25024 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:40.238384 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-4c900972-3952-4150-8c6b-abd6ecb25024 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.165643 Aug 10 03:42:40.238384 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 339/676] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:40 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:40.238641 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-04c45a38-935b-4adf-be40-6a7c5ac34f97 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:40.238641 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-04c45a38-935b-4adf-be40-6a7c5ac34f97 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:40.238641 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-04c45a38-935b-4adf-be40-6a7c5ac34f97 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:40.238641 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-04c45a38-935b-4adf-be40-6a7c5ac34f97 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:40.239505 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-04c45a38-935b-4adf-be40-6a7c5ac34f97 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:40.239505 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-04c45a38-935b-4adf-be40-6a7c5ac34f97 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:40.364294 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-04c45a38-935b-4adf-be40-6a7c5ac34f97 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:40.365443 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d253011b-bf24-468d-bc77-1c9c26e98e0c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:40.366119 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d253011b-bf24-468d-bc77-1c9c26e98e0c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:40.376749 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d253011b-bf24-468d-bc77-1c9c26e98e0c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:40.377263 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-04c45a38-935b-4adf-be40-6a7c5ac34f97 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1556 microversion: 2.1 time: 0.173784 Aug 10 03:42:40.377636 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d253011b-bf24-468d-bc77-1c9c26e98e0c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:40.378262 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 338/677] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:40 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:40.392309 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d253011b-bf24-468d-bc77-1c9c26e98e0c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:40.392309 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d253011b-bf24-468d-bc77-1c9c26e98e0c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:40.418095 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-96b23405-71d3-438a-83cc-7593f9f0a116 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:40.420459 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-96b23405-71d3-438a-83cc-7593f9f0a116 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:40.491784 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-96b23405-71d3-438a-83cc-7593f9f0a116 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:40.499415 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-96b23405-71d3-438a-83cc-7593f9f0a116 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1089 microversion: 2.1 time: 0.085880 Aug 10 03:42:40.504640 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 339/678] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:40 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1089 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:40.549924 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d253011b-bf24-468d-bc77-1c9c26e98e0c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:40.557561 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d253011b-bf24-468d-bc77-1c9c26e98e0c tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1513 microversion: 2.1 time: 0.195903 Aug 10 03:42:40.567924 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 340/679] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:40 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:41.219693 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4cd63b7a-4bfd-49de-a9ef-8a4d38acf9dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:41.220528 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4cd63b7a-4bfd-49de-a9ef-8a4d38acf9dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:41.226969 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4cd63b7a-4bfd-49de-a9ef-8a4d38acf9dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:41.227500 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4cd63b7a-4bfd-49de-a9ef-8a4d38acf9dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:41.228704 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4cd63b7a-4bfd-49de-a9ef-8a4d38acf9dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:41.229215 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4cd63b7a-4bfd-49de-a9ef-8a4d38acf9dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:41.365390 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-4cd63b7a-4bfd-49de-a9ef-8a4d38acf9dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:41.375655 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-4cd63b7a-4bfd-49de-a9ef-8a4d38acf9dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:41.377306 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-4cd63b7a-4bfd-49de-a9ef-8a4d38acf9dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:41.378611 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4cd63b7a-4bfd-49de-a9ef-8a4d38acf9dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.163225 Aug 10 03:42:41.382407 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 340/680] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:41 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:41.394885 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a77c0ba3-a9bb-485b-a39d-7b7b6a200726 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:41.396132 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a77c0ba3-a9bb-485b-a39d-7b7b6a200726 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:41.428483 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a77c0ba3-a9bb-485b-a39d-7b7b6a200726 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:41.429575 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a77c0ba3-a9bb-485b-a39d-7b7b6a200726 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:41.432424 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a77c0ba3-a9bb-485b-a39d-7b7b6a200726 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:41.434130 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a77c0ba3-a9bb-485b-a39d-7b7b6a200726 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:41.515249 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f24c299c-3b96-4f41-bbba-8aa1cd8c5caf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:41.516250 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f24c299c-3b96-4f41-bbba-8aa1cd8c5caf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:41.522216 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f24c299c-3b96-4f41-bbba-8aa1cd8c5caf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:41.522922 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f24c299c-3b96-4f41-bbba-8aa1cd8c5caf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:41.524575 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f24c299c-3b96-4f41-bbba-8aa1cd8c5caf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:41.525418 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f24c299c-3b96-4f41-bbba-8aa1cd8c5caf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:41.580742 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a77c0ba3-a9bb-485b-a39d-7b7b6a200726 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:41.589085 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a77c0ba3-a9bb-485b-a39d-7b7b6a200726 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1556 microversion: 2.1 time: 0.197987 Aug 10 03:42:41.589668 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 341/681] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:41 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1556 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:41.594374 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f9f2baf8-16c5-4ccd-9085-d70141fdb159 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:41.594978 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f9f2baf8-16c5-4ccd-9085-d70141fdb159 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:41.600966 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f9f2baf8-16c5-4ccd-9085-d70141fdb159 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:41.601324 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f9f2baf8-16c5-4ccd-9085-d70141fdb159 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:41.602101 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f9f2baf8-16c5-4ccd-9085-d70141fdb159 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:41.602533 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f9f2baf8-16c5-4ccd-9085-d70141fdb159 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:41.603066 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f24c299c-3b96-4f41-bbba-8aa1cd8c5caf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:41.612579 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f24c299c-3b96-4f41-bbba-8aa1cd8c5caf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1139 microversion: 2.1 time: 0.100969 Aug 10 03:42:41.617040 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 341/682] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:41 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1139 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:41.739567 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f9f2baf8-16c5-4ccd-9085-d70141fdb159 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:41.747222 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f9f2baf8-16c5-4ccd-9085-d70141fdb159 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1513 microversion: 2.1 time: 0.156275 Aug 10 03:42:41.748422 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 342/683] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:41 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:41.875900 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-510319020", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452", "networks": [{"uuid": "cc5377b0-3199-4b12-99e9-e00114dd096c"}]}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:42.404768 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-4df7382e-fa52-4626-8c1a-82f60cc6662e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:42.406133 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-4df7382e-fa52-4626-8c1a-82f60cc6662e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:42.413726 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4df7382e-fa52-4626-8c1a-82f60cc6662e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:42.414356 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4df7382e-fa52-4626-8c1a-82f60cc6662e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:42.415677 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4df7382e-fa52-4626-8c1a-82f60cc6662e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:42.415792 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4df7382e-fa52-4626-8c1a-82f60cc6662e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:42.562084 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4df7382e-fa52-4626-8c1a-82f60cc6662e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:42.570911 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4df7382e-fa52-4626-8c1a-82f60cc6662e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:42.572549 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4df7382e-fa52-4626-8c1a-82f60cc6662e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:42.573852 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-4df7382e-fa52-4626-8c1a-82f60cc6662e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.172790 Aug 10 03:42:42.574615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 343/684] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:42 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:42.605470 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-481e2bf0-bda3-4e58-9599-f71d58da08d4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:42.606121 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-481e2bf0-bda3-4e58-9599-f71d58da08d4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:42.612927 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-481e2bf0-bda3-4e58-9599-f71d58da08d4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:42.613376 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-481e2bf0-bda3-4e58-9599-f71d58da08d4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:42.614239 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-481e2bf0-bda3-4e58-9599-f71d58da08d4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:42.614673 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-481e2bf0-bda3-4e58-9599-f71d58da08d4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:42.771169 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-481e2bf0-bda3-4e58-9599-f71d58da08d4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:42.779948 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-481e2bf0-bda3-4e58-9599-f71d58da08d4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1556 microversion: 2.1 time: 0.178114 Aug 10 03:42:42.780865 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 344/685] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:42 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:42.784929 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-261ec126-7653-4f97-bee1-58d4470aaa2b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:42.785518 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-261ec126-7653-4f97-bee1-58d4470aaa2b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:42.791396 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-261ec126-7653-4f97-bee1-58d4470aaa2b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:42.791838 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-261ec126-7653-4f97-bee1-58d4470aaa2b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:42.792645 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-261ec126-7653-4f97-bee1-58d4470aaa2b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:42.793073 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-261ec126-7653-4f97-bee1-58d4470aaa2b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:42.853318 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-261ec126-7653-4f97-bee1-58d4470aaa2b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:42.862463 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-261ec126-7653-4f97-bee1-58d4470aaa2b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1139 microversion: 2.1 time: 0.080822 Aug 10 03:42:42.863032 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 345/686] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:42 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:42.868040 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-98c4d3f0-b831-481c-9ff1-6abe72b4fb77 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:42.869053 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-98c4d3f0-b831-481c-9ff1-6abe72b4fb77 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:42.875536 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-98c4d3f0-b831-481c-9ff1-6abe72b4fb77 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:42.876006 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-98c4d3f0-b831-481c-9ff1-6abe72b4fb77 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:42.876784 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-98c4d3f0-b831-481c-9ff1-6abe72b4fb77 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:42.877213 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-98c4d3f0-b831-481c-9ff1-6abe72b4fb77 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:43.015830 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-98c4d3f0-b831-481c-9ff1-6abe72b4fb77 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:43.023244 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-98c4d3f0-b831-481c-9ff1-6abe72b4fb77 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1513 microversion: 2.1 time: 0.159278 Aug 10 03:42:43.023798 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 346/687] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:42 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:43.341044 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.network.neutron [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] validate_networks() for [('cc5377b0-3199-4b12-99e9-e00114dd096c', None, None, None)] {{(pid=108440) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:42:43.594495 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-174c9a47-c4cd-46a5-b774-e1c2bf37c5c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:43.596362 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-174c9a47-c4cd-46a5-b774-e1c2bf37c5c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:43.605970 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-174c9a47-c4cd-46a5-b774-e1c2bf37c5c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:43.606640 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-174c9a47-c4cd-46a5-b774-e1c2bf37c5c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:43.608740 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-174c9a47-c4cd-46a5-b774-e1c2bf37c5c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:43.609789 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-174c9a47-c4cd-46a5-b774-e1c2bf37c5c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:43.729432 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Flavor limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:42:43.730168 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Image limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:42:43.731099 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Flavor pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:42:43.731514 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Image pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:42:43.732708 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:42:43.742486 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:43.743090 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:43.743922 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:43.744372 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:43.765858 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Getting quotas for project 2ce125c05e8d4cb99302437ab92ffd2c. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:42:43.769884 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Getting quotas for user f2206fc1fcde4dc4bc9dd24c016c2dbf and project 2ce125c05e8d4cb99302437ab92ffd2c. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:42:43.778145 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-174c9a47-c4cd-46a5-b774-e1c2bf37c5c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:43.781696 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Going to run 1 instances... {{(pid=108440) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:42:43.783973 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:42:43.789847 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-174c9a47-c4cd-46a5-b774-e1c2bf37c5c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:43.793871 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-174c9a47-c4cd-46a5-b774-e1c2bf37c5c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:43.795728 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-174c9a47-c4cd-46a5-b774-e1c2bf37c5c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.205042 Aug 10 03:42:43.808856 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 347/688] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:43 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:43.815463 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a3a86ced-656b-4849-9209-4edcee529264 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:43.816395 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a3a86ced-656b-4849-9209-4edcee529264 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:43.824348 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a3a86ced-656b-4849-9209-4edcee529264 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:43.824876 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a3a86ced-656b-4849-9209-4edcee529264 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:43.827239 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a3a86ced-656b-4849-9209-4edcee529264 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:43.827664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a3a86ced-656b-4849-9209-4edcee529264 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:43.926483 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0c0e8298-8cce-429f-a155-e3dd9f02d562 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.054446 Aug 10 03:42:43.930485 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 342/689] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:42:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 03:42:43.935770 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e823ef82-f9e3-4613-8057-f2f2d7625f3b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:43.936554 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e823ef82-f9e3-4613-8057-f2f2d7625f3b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:43.943021 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e823ef82-f9e3-4613-8057-f2f2d7625f3b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:43.943600 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e823ef82-f9e3-4613-8057-f2f2d7625f3b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:43.944759 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e823ef82-f9e3-4613-8057-f2f2d7625f3b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:43.945309 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e823ef82-f9e3-4613-8057-f2f2d7625f3b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:43.985904 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a3a86ced-656b-4849-9209-4edcee529264 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:43.994631 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a3a86ced-656b-4849-9209-4edcee529264 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1556 microversion: 2.1 time: 0.184241 Aug 10 03:42:43.995486 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 348/690] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:43 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1556 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:44.000445 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d2bdff56-07e4-46dc-852e-14a2bd1c7b09 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:44.001527 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d2bdff56-07e4-46dc-852e-14a2bd1c7b09 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:44.029625 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e823ef82-f9e3-4613-8057-f2f2d7625f3b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:44.038539 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e823ef82-f9e3-4613-8057-f2f2d7625f3b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1139 microversion: 2.1 time: 0.106569 Aug 10 03:42:44.051779 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 343/691] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:43 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1139 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:44.056448 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0eebb5e3-c4c6-46c2-b80e-9909c9f387f4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:44.057052 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0eebb5e3-c4c6-46c2-b80e-9909c9f387f4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:44.063763 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0eebb5e3-c4c6-46c2-b80e-9909c9f387f4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:44.064232 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0eebb5e3-c4c6-46c2-b80e-9909c9f387f4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:44.064999 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0eebb5e3-c4c6-46c2-b80e-9909c9f387f4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:44.065425 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0eebb5e3-c4c6-46c2-b80e-9909c9f387f4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:44.079581 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d2bdff56-07e4-46dc-852e-14a2bd1c7b09 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:44.090959 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d2bdff56-07e4-46dc-852e-14a2bd1c7b09 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1218 microversion: 2.1 time: 0.094146 Aug 10 03:42:44.092333 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 349/692] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:43 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:44.214186 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0eebb5e3-c4c6-46c2-b80e-9909c9f387f4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:44.220333 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0eebb5e3-c4c6-46c2-b80e-9909c9f387f4 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1513 microversion: 2.1 time: 0.167400 Aug 10 03:42:44.220902 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 344/693] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:44 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:44.818302 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-cf7c2208-20c2-4d14-939d-e8c9dd587b63 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:44.818847 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-cf7c2208-20c2-4d14-939d-e8c9dd587b63 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:44.824807 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cf7c2208-20c2-4d14-939d-e8c9dd587b63 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:44.825288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cf7c2208-20c2-4d14-939d-e8c9dd587b63 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:44.826988 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cf7c2208-20c2-4d14-939d-e8c9dd587b63 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:44.827843 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cf7c2208-20c2-4d14-939d-e8c9dd587b63 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:44.950542 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-cf7c2208-20c2-4d14-939d-e8c9dd587b63 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:44.959510 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-cf7c2208-20c2-4d14-939d-e8c9dd587b63 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:44.961031 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-cf7c2208-20c2-4d14-939d-e8c9dd587b63 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:44.962171 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-cf7c2208-20c2-4d14-939d-e8c9dd587b63 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.147705 Aug 10 03:42:44.963187 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 350/694] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:44 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:45.019226 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3b54bf59-9269-4df2-9438-28bf21a9731a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:45.019976 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3b54bf59-9269-4df2-9438-28bf21a9731a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:45.025771 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3b54bf59-9269-4df2-9438-28bf21a9731a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:45.026218 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3b54bf59-9269-4df2-9438-28bf21a9731a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:45.026992 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3b54bf59-9269-4df2-9438-28bf21a9731a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:45.027429 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3b54bf59-9269-4df2-9438-28bf21a9731a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:45.056738 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1bc3cf91-c322-4c32-87af-42c2ab8ca29e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:45.057425 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1bc3cf91-c322-4c32-87af-42c2ab8ca29e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:45.063880 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1bc3cf91-c322-4c32-87af-42c2ab8ca29e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:45.064343 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1bc3cf91-c322-4c32-87af-42c2ab8ca29e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:45.065142 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1bc3cf91-c322-4c32-87af-42c2ab8ca29e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:45.065573 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1bc3cf91-c322-4c32-87af-42c2ab8ca29e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:45.124897 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1bc3cf91-c322-4c32-87af-42c2ab8ca29e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:45.135426 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1bc3cf91-c322-4c32-87af-42c2ab8ca29e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1139 microversion: 2.1 time: 0.082133 Aug 10 03:42:45.136246 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 351/695] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:45 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:45.141276 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a13b44bb-e24b-46bd-a1bf-b814d689bbf4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:45.141876 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a13b44bb-e24b-46bd-a1bf-b814d689bbf4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:45.162864 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3b54bf59-9269-4df2-9438-28bf21a9731a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:45.170690 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3b54bf59-9269-4df2-9438-28bf21a9731a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1556 microversion: 2.1 time: 0.155129 Aug 10 03:42:45.171258 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 345/696] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:45 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:45.192363 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a13b44bb-e24b-46bd-a1bf-b814d689bbf4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:45.198966 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a13b44bb-e24b-46bd-a1bf-b814d689bbf4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1218 microversion: 2.1 time: 0.061595 Aug 10 03:42:45.199535 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 352/697] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:45 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1218 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:45.237191 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ff23beb5-73f0-4e8e-b04b-c798689e27d0 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:45.237801 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ff23beb5-73f0-4e8e-b04b-c798689e27d0 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:45.243751 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff23beb5-73f0-4e8e-b04b-c798689e27d0 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:45.244136 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff23beb5-73f0-4e8e-b04b-c798689e27d0 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:45.244940 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff23beb5-73f0-4e8e-b04b-c798689e27d0 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:45.245383 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff23beb5-73f0-4e8e-b04b-c798689e27d0 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:45.372284 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ff23beb5-73f0-4e8e-b04b-c798689e27d0 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:45.380160 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ff23beb5-73f0-4e8e-b04b-c798689e27d0 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1513 microversion: 2.1 time: 0.146936 Aug 10 03:42:45.380747 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 346/698] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:45 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:45.981631 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-aec16f3b-d335-42ed-8624-0fc8beaa976f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:45.982899 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-aec16f3b-d335-42ed-8624-0fc8beaa976f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:45.989320 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aec16f3b-d335-42ed-8624-0fc8beaa976f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:45.989767 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aec16f3b-d335-42ed-8624-0fc8beaa976f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:45.990562 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aec16f3b-d335-42ed-8624-0fc8beaa976f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:45.990992 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aec16f3b-d335-42ed-8624-0fc8beaa976f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:46.152567 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-587efefd-15bc-43bc-892b-15f2e44acad6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:46.153150 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-587efefd-15bc-43bc-892b-15f2e44acad6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:46.160495 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-587efefd-15bc-43bc-892b-15f2e44acad6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:46.160944 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-587efefd-15bc-43bc-892b-15f2e44acad6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:46.161741 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-587efefd-15bc-43bc-892b-15f2e44acad6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:46.162246 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-587efefd-15bc-43bc-892b-15f2e44acad6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:46.226474 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-587efefd-15bc-43bc-892b-15f2e44acad6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:46.237318 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-587efefd-15bc-43bc-892b-15f2e44acad6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1187 microversion: 2.1 time: 0.088576 Aug 10 03:42:46.244159 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 347/699] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:46 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:46.244159 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ae262200-db5d-4fa9-9a83-21b4d38e24f5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:46.244159 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ae262200-db5d-4fa9-9a83-21b4d38e24f5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:46.250785 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ae262200-db5d-4fa9-9a83-21b4d38e24f5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:46.251234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ae262200-db5d-4fa9-9a83-21b4d38e24f5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:46.252012 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ae262200-db5d-4fa9-9a83-21b4d38e24f5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:46.252469 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ae262200-db5d-4fa9-9a83-21b4d38e24f5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:46.319362 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-aec16f3b-d335-42ed-8624-0fc8beaa976f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:46.328279 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-aec16f3b-d335-42ed-8624-0fc8beaa976f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:46.331317 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-aec16f3b-d335-42ed-8624-0fc8beaa976f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:46.331317 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-aec16f3b-d335-42ed-8624-0fc8beaa976f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.354369 Aug 10 03:42:46.331526 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 353/700] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:45 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:46.335785 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0a8f57b0-92b4-4dc0-a1a2-5f99165cb1a5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:46.336623 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0a8f57b0-92b4-4dc0-a1a2-5f99165cb1a5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:46.343162 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0a8f57b0-92b4-4dc0-a1a2-5f99165cb1a5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:46.343613 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0a8f57b0-92b4-4dc0-a1a2-5f99165cb1a5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:46.344436 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0a8f57b0-92b4-4dc0-a1a2-5f99165cb1a5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:46.344869 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0a8f57b0-92b4-4dc0-a1a2-5f99165cb1a5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:46.405918 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0a8f57b0-92b4-4dc0-a1a2-5f99165cb1a5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:46.414330 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0a8f57b0-92b4-4dc0-a1a2-5f99165cb1a5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1270 microversion: 2.1 time: 0.081743 Aug 10 03:42:46.414828 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 354/701] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:46 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1270 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:46.419817 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a09fe630-b349-4189-9d78-dbbb800ca301 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:46.420441 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a09fe630-b349-4189-9d78-dbbb800ca301 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:46.426041 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a09fe630-b349-4189-9d78-dbbb800ca301 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:46.426477 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a09fe630-b349-4189-9d78-dbbb800ca301 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:46.427460 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a09fe630-b349-4189-9d78-dbbb800ca301 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:46.427884 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a09fe630-b349-4189-9d78-dbbb800ca301 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:46.437686 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ae262200-db5d-4fa9-9a83-21b4d38e24f5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:46.445812 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ae262200-db5d-4fa9-9a83-21b4d38e24f5 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1562 microversion: 2.1 time: 0.206923 Aug 10 03:42:46.446388 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 348/702] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:46 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1562 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:46.520738 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f84e00ed-a4b0-40a3-a610-a418d5ece7c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:46.521230 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f84e00ed-a4b0-40a3-a610-a418d5ece7c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:46.528092 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f84e00ed-a4b0-40a3-a610-a418d5ece7c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:46.529369 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f84e00ed-a4b0-40a3-a610-a418d5ece7c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:46.530646 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f84e00ed-a4b0-40a3-a610-a418d5ece7c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:46.531286 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f84e00ed-a4b0-40a3-a610-a418d5ece7c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:46.567800 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a09fe630-b349-4189-9d78-dbbb800ca301 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:46.576242 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a09fe630-b349-4189-9d78-dbbb800ca301 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1513 microversion: 2.1 time: 0.160366 Aug 10 03:42:46.586174 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 355/703] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:46 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:46.630286 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-f84e00ed-a4b0-40a3-a610-a418d5ece7c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lazy-loading 'services' on Instance uuid f2c37d94-d078-4e35-819d-2ca11fc5cb5f {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:42:46.907814 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f84e00ed-a4b0-40a3-a610-a418d5ece7c8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments/93916f10-f05b-432a-ac03-625b1adadb11" status: 202 len: 0 microversion: 2.1 time: 0.390651 Aug 10 03:42:46.908489 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 349/704] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 10 03:42:46 2021] DELETE /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments/93916f10-f05b-432a-ac03-625b1adadb11 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:42:46.923639 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-78880536-fbdf-4b74-95cc-578ecc0aa74f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:46.924745 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-78880536-fbdf-4b74-95cc-578ecc0aa74f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:46.930776 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-78880536-fbdf-4b74-95cc-578ecc0aa74f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:46.931278 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-78880536-fbdf-4b74-95cc-578ecc0aa74f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:46.937549 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-78880536-fbdf-4b74-95cc-578ecc0aa74f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:46.937549 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-78880536-fbdf-4b74-95cc-578ecc0aa74f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:46.962685 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-78880536-fbdf-4b74-95cc-578ecc0aa74f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043530 Aug 10 03:42:46.963351 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 356/705] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:42:46 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:42:47.255145 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e9ab3f4e-c5fb-43e3-97d9-7f943cdf2b75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:47.255851 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e9ab3f4e-c5fb-43e3-97d9-7f943cdf2b75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:47.262003 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e9ab3f4e-c5fb-43e3-97d9-7f943cdf2b75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:47.262434 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e9ab3f4e-c5fb-43e3-97d9-7f943cdf2b75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:47.263232 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e9ab3f4e-c5fb-43e3-97d9-7f943cdf2b75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:47.263657 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e9ab3f4e-c5fb-43e3-97d9-7f943cdf2b75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:47.349229 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8eaa52f9-8433-4595-8985-80ff55e71353 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:47.350412 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8eaa52f9-8433-4595-8985-80ff55e71353 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:47.356156 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8eaa52f9-8433-4595-8985-80ff55e71353 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:47.356637 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8eaa52f9-8433-4595-8985-80ff55e71353 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:47.357962 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8eaa52f9-8433-4595-8985-80ff55e71353 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:47.358389 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8eaa52f9-8433-4595-8985-80ff55e71353 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:47.365023 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e9ab3f4e-c5fb-43e3-97d9-7f943cdf2b75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:47.374702 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e9ab3f4e-c5fb-43e3-97d9-7f943cdf2b75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1205 microversion: 2.1 time: 0.123639 Aug 10 03:42:47.375551 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 350/706] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:47 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1205 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:47.431218 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-5fd39e6d-e0a1-4641-903e-bbe8f3ed65eb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:47.431811 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-5fd39e6d-e0a1-4641-903e-bbe8f3ed65eb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:47.438187 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5fd39e6d-e0a1-4641-903e-bbe8f3ed65eb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:47.439308 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5fd39e6d-e0a1-4641-903e-bbe8f3ed65eb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:47.440317 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5fd39e6d-e0a1-4641-903e-bbe8f3ed65eb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:47.440870 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5fd39e6d-e0a1-4641-903e-bbe8f3ed65eb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:47.505567 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8eaa52f9-8433-4595-8985-80ff55e71353 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:47.514147 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8eaa52f9-8433-4595-8985-80ff55e71353 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:47.515641 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8eaa52f9-8433-4595-8985-80ff55e71353 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:47.516828 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8eaa52f9-8433-4595-8985-80ff55e71353 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.171306 Aug 10 03:42:47.517371 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 357/707] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:47 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:47.564302 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-5fd39e6d-e0a1-4641-903e-bbe8f3ed65eb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:47.571882 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-5fd39e6d-e0a1-4641-903e-bbe8f3ed65eb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1276 microversion: 2.1 time: 0.144429 Aug 10 03:42:47.573786 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 351/708] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:47 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:47.594268 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-bd082569-40f2-44bb-981c-134539a1b4e3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:47.594780 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-bd082569-40f2-44bb-981c-134539a1b4e3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:47.601118 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd082569-40f2-44bb-981c-134539a1b4e3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:47.609738 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd082569-40f2-44bb-981c-134539a1b4e3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:47.609738 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd082569-40f2-44bb-981c-134539a1b4e3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:47.609738 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd082569-40f2-44bb-981c-134539a1b4e3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:47.756834 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bd082569-40f2-44bb-981c-134539a1b4e3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:47.765186 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-bd082569-40f2-44bb-981c-134539a1b4e3 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1513 microversion: 2.1 time: 0.175737 Aug 10 03:42:47.765747 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 358/709] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:47 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:47.974784 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d53df301-2774-4127-a5a8-76a93262f03d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:47.975754 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d53df301-2774-4127-a5a8-76a93262f03d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:47.981772 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d53df301-2774-4127-a5a8-76a93262f03d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:47.982232 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d53df301-2774-4127-a5a8-76a93262f03d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:47.983012 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d53df301-2774-4127-a5a8-76a93262f03d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:47.983446 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d53df301-2774-4127-a5a8-76a93262f03d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:48.016369 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d53df301-2774-4127-a5a8-76a93262f03d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045239 Aug 10 03:42:48.017334 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 352/710] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:42:47 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:42:48.032572 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-2be94109-b9e2-45cf-84f9-adb16530682b req-f7b16387-5af7-49bd-aa39-a24032475aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a912ff3-ac1a-4d82-971a-be7ebb16c176", "name": "network-vif-deleted", "tag": "10d027a5-7309-4d2a-a189-a95629488e03"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:48.034210 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:42:48.034210 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:42:48.041856 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-2be94109-b9e2-45cf-84f9-adb16530682b req-f7b16387-5af7-49bd-aa39-a24032475aa0 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:48.042295 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-2be94109-b9e2-45cf-84f9-adb16530682b req-f7b16387-5af7-49bd-aa39-a24032475aa0 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:48.053916 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-2be94109-b9e2-45cf-84f9-adb16530682b req-f7b16387-5af7-49bd-aa39-a24032475aa0 service nova] Creating event network-vif-deleted:10d027a5-7309-4d2a-a189-a95629488e03 for instance 3a912ff3-ac1a-4d82-971a-be7ebb16c176 on hv-cinder-78239 Aug 10 03:42:48.059501 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-2be94109-b9e2-45cf-84f9-adb16530682b req-f7b16387-5af7-49bd-aa39-a24032475aa0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031056 Aug 10 03:42:48.061031 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 359/711] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:42:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:42:48.397320 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3730ab4f-ccac-46f9-9645-364c79fe0695 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:48.399223 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3730ab4f-ccac-46f9-9645-364c79fe0695 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:48.406464 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3730ab4f-ccac-46f9-9645-364c79fe0695 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:48.406974 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3730ab4f-ccac-46f9-9645-364c79fe0695 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:48.420122 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3730ab4f-ccac-46f9-9645-364c79fe0695 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:48.420122 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3730ab4f-ccac-46f9-9645-364c79fe0695 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:48.535965 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1e13d564-f349-4716-8321-af23d7721031 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:48.537247 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1e13d564-f349-4716-8321-af23d7721031 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:48.544340 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e13d564-f349-4716-8321-af23d7721031 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:48.544898 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e13d564-f349-4716-8321-af23d7721031 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:48.545797 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e13d564-f349-4716-8321-af23d7721031 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:48.546331 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e13d564-f349-4716-8321-af23d7721031 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:48.630441 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3730ab4f-ccac-46f9-9645-364c79fe0695 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:48.649907 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3730ab4f-ccac-46f9-9645-364c79fe0695 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.256968 Aug 10 03:42:48.660112 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 353/712] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:48 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:48.660112 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0df1fdff-4d9a-415e-b72b-2bf8020dfdb9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:48.660112 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0df1fdff-4d9a-415e-b72b-2bf8020dfdb9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:48.664083 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0df1fdff-4d9a-415e-b72b-2bf8020dfdb9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:48.664499 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0df1fdff-4d9a-415e-b72b-2bf8020dfdb9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:48.665605 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0df1fdff-4d9a-415e-b72b-2bf8020dfdb9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:48.666116 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0df1fdff-4d9a-415e-b72b-2bf8020dfdb9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:48.683166 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1e13d564-f349-4716-8321-af23d7721031 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:48.695586 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1e13d564-f349-4716-8321-af23d7721031 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:48.697599 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1e13d564-f349-4716-8321-af23d7721031 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:48.698760 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1e13d564-f349-4716-8321-af23d7721031 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.166979 Aug 10 03:42:48.699381 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 360/713] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:48 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:48.784166 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-16efabf9-dafe-4d06-ad44-87ae259b5d7f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:48.785858 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-16efabf9-dafe-4d06-ad44-87ae259b5d7f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:48.793412 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16efabf9-dafe-4d06-ad44-87ae259b5d7f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:48.793906 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16efabf9-dafe-4d06-ad44-87ae259b5d7f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:48.801418 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16efabf9-dafe-4d06-ad44-87ae259b5d7f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:48.802157 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16efabf9-dafe-4d06-ad44-87ae259b5d7f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:48.869754 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16efabf9-dafe-4d06-ad44-87ae259b5d7f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:48.869754 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16efabf9-dafe-4d06-ad44-87ae259b5d7f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:48.869754 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-16efabf9-dafe-4d06-ad44-87ae259b5d7f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lazy-loading 'fault' on Instance uuid 3a912ff3-ac1a-4d82-971a-be7ebb16c176 {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:42:48.933579 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-16efabf9-dafe-4d06-ad44-87ae259b5d7f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a0eaef1ba4df5a07bda5bef95dd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0218bd23bab4457abfb072f168e61af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:48.942150 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-16efabf9-dafe-4d06-ad44-87ae259b5d7f tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 200 len: 1308 microversion: 2.1 time: 0.163248 Aug 10 03:42:48.942741 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 361/714] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:48 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 1308 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:48.949830 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 03:42:48.950273 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: Tue Aug 10 03:42:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 (ip 10.222.0.21) !!! Aug 10 03:42:48.963898 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0df1fdff-4d9a-415e-b72b-2bf8020dfdb9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:48.973186 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0df1fdff-4d9a-415e-b72b-2bf8020dfdb9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1318 microversion: 2.1 time: 0.320549 Aug 10 03:42:48.977540 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 354/715] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:48 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:49.029482 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d5eb0561-fa34-44f9-a199-85c15949803c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:49.029482 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d5eb0561-fa34-44f9-a199-85c15949803c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:49.035009 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d5eb0561-fa34-44f9-a199-85c15949803c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:49.035457 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d5eb0561-fa34-44f9-a199-85c15949803c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:49.036293 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d5eb0561-fa34-44f9-a199-85c15949803c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:49.037003 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d5eb0561-fa34-44f9-a199-85c15949803c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:49.069385 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d5eb0561-fa34-44f9-a199-85c15949803c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045571 Aug 10 03:42:49.070061 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 362/716] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:42:49 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:42:49.668560 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0b7d9d35-aeea-41a4-8ccd-ef406e1bf976 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:49.671588 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0b7d9d35-aeea-41a4-8ccd-ef406e1bf976 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:49.676086 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0b7d9d35-aeea-41a4-8ccd-ef406e1bf976 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:49.676632 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0b7d9d35-aeea-41a4-8ccd-ef406e1bf976 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:49.677420 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0b7d9d35-aeea-41a4-8ccd-ef406e1bf976 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:49.677851 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0b7d9d35-aeea-41a4-8ccd-ef406e1bf976 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:49.717834 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5902df4b-8754-4d03-b206-5b66116583ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:49.718512 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-5902df4b-8754-4d03-b206-5b66116583ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:49.724938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5902df4b-8754-4d03-b206-5b66116583ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:49.725377 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5902df4b-8754-4d03-b206-5b66116583ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:49.726151 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5902df4b-8754-4d03-b206-5b66116583ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:49.726575 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5902df4b-8754-4d03-b206-5b66116583ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:49.866279 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-5902df4b-8754-4d03-b206-5b66116583ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:49.876769 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-5902df4b-8754-4d03-b206-5b66116583ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:49.878578 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-5902df4b-8754-4d03-b206-5b66116583ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:49.879868 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5902df4b-8754-4d03-b206-5b66116583ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.166360 Aug 10 03:42:49.880615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 363/717] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:49 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:49.959860 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-150635a6-8885-4fac-b548-9ff03eddb824 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:49.960493 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-150635a6-8885-4fac-b548-9ff03eddb824 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] [instance: 3a912ff3-ac1a-4d82-971a-be7ebb16c176] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:49.966960 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-150635a6-8885-4fac-b548-9ff03eddb824 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:49.967399 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-150635a6-8885-4fac-b548-9ff03eddb824 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:49.968409 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-150635a6-8885-4fac-b548-9ff03eddb824 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:49.968986 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-150635a6-8885-4fac-b548-9ff03eddb824 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:49.990910 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-150635a6-8885-4fac-b548-9ff03eddb824 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] HTTP exception thrown: Instance 3a912ff3-ac1a-4d82-971a-be7ebb16c176 could not be found. Aug 10 03:42:49.991750 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-150635a6-8885-4fac-b548-9ff03eddb824 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] Returning 404 to user: Instance 3a912ff3-ac1a-4d82-971a-be7ebb16c176 could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:42:49.992714 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-150635a6-8885-4fac-b548-9ff03eddb824 tempest-AttachVolumeNegativeTest-1577780992 tempest-AttachVolumeNegativeTest-1577780992-project] 10.222.0.21 "GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176" status: 404 len: 111 microversion: 2.1 time: 0.036400 Aug 10 03:42:49.996589 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 364/718] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:49 2021] GET /compute/v2.1/servers/3a912ff3-ac1a-4d82-971a-be7ebb16c176 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 03:42:50.001949 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e5357463-6768-4db4-9b51-c4a3075c7f1d tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:50.002774 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e5357463-6768-4db4-9b51-c4a3075c7f1d tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:50.009362 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5357463-6768-4db4-9b51-c4a3075c7f1d tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:50.010064 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5357463-6768-4db4-9b51-c4a3075c7f1d tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:50.010999 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5357463-6768-4db4-9b51-c4a3075c7f1d tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:50.011580 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5357463-6768-4db4-9b51-c4a3075c7f1d tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:50.210181 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0b7d9d35-aeea-41a4-8ccd-ef406e1bf976 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:50.220177 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0b7d9d35-aeea-41a4-8ccd-ef406e1bf976 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.555150 Aug 10 03:42:50.220993 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 355/719] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:49 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:50.237321 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e987df26-d39d-45ed-8fb3-a594ad60b792 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:50.238804 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e987df26-d39d-45ed-8fb3-a594ad60b792 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:50.243259 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e5357463-6768-4db4-9b51-c4a3075c7f1d tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:50.256363 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e5357463-6768-4db4-9b51-c4a3075c7f1d tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1318 microversion: 2.1 time: 0.258337 Aug 10 03:42:50.257013 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e987df26-d39d-45ed-8fb3-a594ad60b792 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:50.257539 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e987df26-d39d-45ed-8fb3-a594ad60b792 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:50.258580 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e987df26-d39d-45ed-8fb3-a594ad60b792 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:50.259501 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e987df26-d39d-45ed-8fb3-a594ad60b792 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:50.267384 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 365/720] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:49 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:50.279629 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-3f114983-3415-4d7f-bbc5-cdb4e9bf607f req-7f0a70b7-8f2a-4469-a357-c88c0c7eb998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a89090-7d79-496b-878d-213d6f48b970", "tag": "6f883b5b-35b9-44d5-8f3d-ba0bf7b04925"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:50.283133 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:42:50.283133 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:42:50.290008 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-3f114983-3415-4d7f-bbc5-cdb4e9bf607f req-7f0a70b7-8f2a-4469-a357-c88c0c7eb998 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:50.290450 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-3f114983-3415-4d7f-bbc5-cdb4e9bf607f req-7f0a70b7-8f2a-4469-a357-c88c0c7eb998 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:50.308638 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-3f114983-3415-4d7f-bbc5-cdb4e9bf607f req-7f0a70b7-8f2a-4469-a357-c88c0c7eb998 service nova] Creating event network-changed:6f883b5b-35b9-44d5-8f3d-ba0bf7b04925 for instance 43a89090-7d79-496b-878d-213d6f48b970 on hv-cinder-78239 Aug 10 03:42:50.312400 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e987df26-d39d-45ed-8fb3-a594ad60b792 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089761 Aug 10 03:42:50.313062 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 356/721] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:42:50 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:42:50.315409 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-3f114983-3415-4d7f-bbc5-cdb4e9bf607f req-7f0a70b7-8f2a-4469-a357-c88c0c7eb998 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044170 Aug 10 03:42:50.316304 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 366/722] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:42:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:42:50.899100 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-59075e71-c4d0-44c1-b1d4-bce899ff027b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:50.900274 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-59075e71-c4d0-44c1-b1d4-bce899ff027b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:50.907156 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-59075e71-c4d0-44c1-b1d4-bce899ff027b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:50.907543 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-59075e71-c4d0-44c1-b1d4-bce899ff027b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:50.914900 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-59075e71-c4d0-44c1-b1d4-bce899ff027b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:50.914900 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-59075e71-c4d0-44c1-b1d4-bce899ff027b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:51.207108 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-59075e71-c4d0-44c1-b1d4-bce899ff027b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:51.217024 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-59075e71-c4d0-44c1-b1d4-bce899ff027b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:51.218544 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-59075e71-c4d0-44c1-b1d4-bce899ff027b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:51.220030 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-59075e71-c4d0-44c1-b1d4-bce899ff027b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.324740 Aug 10 03:42:51.220629 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 357/723] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:50 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:51.238933 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8e49266b-d382-43ec-be4d-bfd68cd68a4f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:51.247791 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8e49266b-d382-43ec-be4d-bfd68cd68a4f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:51.247791 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8e49266b-d382-43ec-be4d-bfd68cd68a4f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:51.247791 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8e49266b-d382-43ec-be4d-bfd68cd68a4f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:51.248329 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8e49266b-d382-43ec-be4d-bfd68cd68a4f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:51.248415 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8e49266b-d382-43ec-be4d-bfd68cd68a4f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:51.275272 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1ea6519f-365d-474e-ad26-2f771faf8e9e tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:51.276304 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1ea6519f-365d-474e-ad26-2f771faf8e9e tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:51.285032 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1ea6519f-365d-474e-ad26-2f771faf8e9e tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:51.285568 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1ea6519f-365d-474e-ad26-2f771faf8e9e tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:51.286481 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1ea6519f-365d-474e-ad26-2f771faf8e9e tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:51.287269 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1ea6519f-365d-474e-ad26-2f771faf8e9e tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:51.383434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8e49266b-d382-43ec-be4d-bfd68cd68a4f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:51.391369 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8e49266b-d382-43ec-be4d-bfd68cd68a4f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.156990 Aug 10 03:42:51.392171 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 367/724] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:51 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:51.556016 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1ea6519f-365d-474e-ad26-2f771faf8e9e tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:51.563383 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1ea6519f-365d-474e-ad26-2f771faf8e9e tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1318 microversion: 2.1 time: 0.293131 Aug 10 03:42:51.572472 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 358/725] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:51 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:52.240478 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e03b6d0d-c483-40b1-a128-4e3aa6baf925 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:52.241159 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e03b6d0d-c483-40b1-a128-4e3aa6baf925 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:52.247468 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e03b6d0d-c483-40b1-a128-4e3aa6baf925 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:52.248462 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e03b6d0d-c483-40b1-a128-4e3aa6baf925 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:52.249209 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e03b6d0d-c483-40b1-a128-4e3aa6baf925 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:52.249710 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e03b6d0d-c483-40b1-a128-4e3aa6baf925 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:52.333041 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-e7758066-0c09-40d3-8a0a-02556164150f req-6797a0f1-58a9-4865-b964-1130972f38f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc93e7b-20ee-49c2-8f30-c97c884a1118", "tag": "096af4bc-acc2-42b7-8512-7a1b982bef27"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:52.335386 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:42:52.335386 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:42:52.347372 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-e7758066-0c09-40d3-8a0a-02556164150f req-6797a0f1-58a9-4865-b964-1130972f38f5 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:52.348346 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-e7758066-0c09-40d3-8a0a-02556164150f req-6797a0f1-58a9-4865-b964-1130972f38f5 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:52.369822 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-e7758066-0c09-40d3-8a0a-02556164150f req-6797a0f1-58a9-4865-b964-1130972f38f5 service nova] Creating event network-changed:096af4bc-acc2-42b7-8512-7a1b982bef27 for instance 1dc93e7b-20ee-49c2-8f30-c97c884a1118 on hv-cinder-78239 Aug 10 03:42:52.378571 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-e7758066-0c09-40d3-8a0a-02556164150f req-6797a0f1-58a9-4865-b964-1130972f38f5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050255 Aug 10 03:42:52.379741 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 359/726] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:42:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:42:52.397006 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e03b6d0d-c483-40b1-a128-4e3aa6baf925 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:52.409425 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e03b6d0d-c483-40b1-a128-4e3aa6baf925 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:52.416325 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f796627c-3a3a-4f8e-9f29-2927435e3512 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:52.416325 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f796627c-3a3a-4f8e-9f29-2927435e3512 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:52.418969 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e03b6d0d-c483-40b1-a128-4e3aa6baf925 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:52.420723 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f796627c-3a3a-4f8e-9f29-2927435e3512 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:52.420943 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e03b6d0d-c483-40b1-a128-4e3aa6baf925 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.184038 Aug 10 03:42:52.421354 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f796627c-3a3a-4f8e-9f29-2927435e3512 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:52.422660 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f796627c-3a3a-4f8e-9f29-2927435e3512 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:52.423195 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f796627c-3a3a-4f8e-9f29-2927435e3512 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:52.423648 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 368/727] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:52 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:52.580233 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-833a2708-7d68-43f7-978f-e4e6d2eacb59 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:52.581175 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-833a2708-7d68-43f7-978f-e4e6d2eacb59 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:52.594326 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-833a2708-7d68-43f7-978f-e4e6d2eacb59 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:52.596575 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-833a2708-7d68-43f7-978f-e4e6d2eacb59 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:52.597639 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-833a2708-7d68-43f7-978f-e4e6d2eacb59 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:52.598238 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-833a2708-7d68-43f7-978f-e4e6d2eacb59 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:52.629157 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f796627c-3a3a-4f8e-9f29-2927435e3512 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:52.649917 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f796627c-3a3a-4f8e-9f29-2927435e3512 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.235032 Aug 10 03:42:52.655237 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 360/728] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:52 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:52.767449 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-833a2708-7d68-43f7-978f-e4e6d2eacb59 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:52.776080 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-833a2708-7d68-43f7-978f-e4e6d2eacb59 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1318 microversion: 2.1 time: 0.199841 Aug 10 03:42:52.777541 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 369/729] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:52 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:53.185577 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f071bf15-ba11-49cb-a79b-0ee218778d2a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:53.186312 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f071bf15-ba11-49cb-a79b-0ee218778d2a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:53.189821 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-20d6c322-3577-42a0-819a-ad5a885fbce0 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Action: 'create', calling method: .version_select at 0x7f97a14e78b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1441330282"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:53.192609 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f071bf15-ba11-49cb-a79b-0ee218778d2a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:53.200432 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f071bf15-ba11-49cb-a79b-0ee218778d2a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:53.200432 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f071bf15-ba11-49cb-a79b-0ee218778d2a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:53.200432 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f071bf15-ba11-49cb-a79b-0ee218778d2a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:53.221041 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f071bf15-ba11-49cb-a79b-0ee218778d2a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Going to try to terminate instance {{(pid=108439) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:42:53.530913 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f071bf15-ba11-49cb-a79b-0ee218778d2a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "DELETE /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 204 len: 0 microversion: 2.1 time: 0.348879 Aug 10 03:42:53.531622 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 370/730] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:42:53 2021] DELETE /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 03:42:53.540461 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f3117759-fd4b-4e85-abfc-f7f68eeab54a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:53.540461 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f3117759-fd4b-4e85-abfc-f7f68eeab54a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:53.542973 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f3117759-fd4b-4e85-abfc-f7f68eeab54a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:53.543412 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f3117759-fd4b-4e85-abfc-f7f68eeab54a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:53.544191 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f3117759-fd4b-4e85-abfc-f7f68eeab54a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:53.544640 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f3117759-fd4b-4e85-abfc-f7f68eeab54a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:53.670277 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f3117759-fd4b-4e85-abfc-f7f68eeab54a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:53.679371 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f3117759-fd4b-4e85-abfc-f7f68eeab54a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:53.680897 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f3117759-fd4b-4e85-abfc-f7f68eeab54a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:53.682021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f3117759-fd4b-4e85-abfc-f7f68eeab54a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.149466 Aug 10 03:42:53.682571 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 371/731] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:53 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:53.687380 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-27947f12-247f-4440-a4a3-bdb1013e72ca tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:53.687970 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-27947f12-247f-4440-a4a3-bdb1013e72ca tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:53.693438 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-27947f12-247f-4440-a4a3-bdb1013e72ca tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:53.693935 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-27947f12-247f-4440-a4a3-bdb1013e72ca tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:53.694698 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-27947f12-247f-4440-a4a3-bdb1013e72ca tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:53.695124 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-27947f12-247f-4440-a4a3-bdb1013e72ca tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:53.816552 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-27947f12-247f-4440-a4a3-bdb1013e72ca tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:53.823753 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-27947f12-247f-4440-a4a3-bdb1013e72ca tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1509 microversion: 2.1 time: 0.140232 Aug 10 03:42:53.824335 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 372/732] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:53 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1509 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:53.828999 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e27ebb4b-fcfe-4af8-a004-2d3d439d3914 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:53.829601 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e27ebb4b-fcfe-4af8-a004-2d3d439d3914 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:53.834850 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e27ebb4b-fcfe-4af8-a004-2d3d439d3914 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:53.835288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e27ebb4b-fcfe-4af8-a004-2d3d439d3914 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:53.836036 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e27ebb4b-fcfe-4af8-a004-2d3d439d3914 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:53.836489 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e27ebb4b-fcfe-4af8-a004-2d3d439d3914 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:53.963099 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e27ebb4b-fcfe-4af8-a004-2d3d439d3914 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:53.970590 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e27ebb4b-fcfe-4af8-a004-2d3d439d3914 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.145258 Aug 10 03:42:53.971171 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 373/733] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:53 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:53.975466 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-bb274ae2-b392-4f26-a496-b5c268c56352 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:53.976050 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-bb274ae2-b392-4f26-a496-b5c268c56352 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:53.982465 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bb274ae2-b392-4f26-a496-b5c268c56352 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:53.982900 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bb274ae2-b392-4f26-a496-b5c268c56352 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:53.983646 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bb274ae2-b392-4f26-a496-b5c268c56352 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:53.984071 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bb274ae2-b392-4f26-a496-b5c268c56352 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:54.091087 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-20d6c322-3577-42a0-819a-ad5a885fbce0 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.016389 Aug 10 03:42:54.091837 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 361/734] 10.222.0.21 () {60 vars in 1155 bytes} [Tue Aug 10 03:42:53 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 1018 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 10 03:42:54.102474 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-05925e4f-b6d3-4f23-af50-5207fa6458a2 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a01b4ca0>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:54.137586 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bb274ae2-b392-4f26-a496-b5c268c56352 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:54.145965 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-bb274ae2-b392-4f26-a496-b5c268c56352 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1318 microversion: 2.1 time: 0.173818 Aug 10 03:42:54.146719 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 374/735] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:53 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:54.167037 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-05925e4f-b6d3-4f23-af50-5207fa6458a2 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3" status: 200 len: 345 microversion: 2.1 time: 0.068362 Aug 10 03:42:54.167600 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 362/736] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:42:54 2021] GET /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:42:54.701275 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-bd0a169f-4dd5-44e6-8898-aaff6120c5dd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:54.702047 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-bd0a169f-4dd5-44e6-8898-aaff6120c5dd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:54.708230 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd0a169f-4dd5-44e6-8898-aaff6120c5dd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:54.708675 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd0a169f-4dd5-44e6-8898-aaff6120c5dd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:54.709513 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd0a169f-4dd5-44e6-8898-aaff6120c5dd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:54.709942 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd0a169f-4dd5-44e6-8898-aaff6120c5dd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:54.834060 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bd0a169f-4dd5-44e6-8898-aaff6120c5dd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:54.840362 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d904b1a4-0aa7-44e8-b531-210d3d05fdde tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:54.841005 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d904b1a4-0aa7-44e8-b531-210d3d05fdde tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:54.843681 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bd0a169f-4dd5-44e6-8898-aaff6120c5dd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:54.844950 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bd0a169f-4dd5-44e6-8898-aaff6120c5dd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:54.847235 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-bd0a169f-4dd5-44e6-8898-aaff6120c5dd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.150117 Aug 10 03:42:54.856596 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d904b1a4-0aa7-44e8-b531-210d3d05fdde tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:54.857567 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d904b1a4-0aa7-44e8-b531-210d3d05fdde tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:54.858584 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d904b1a4-0aa7-44e8-b531-210d3d05fdde tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:54.858871 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 375/737] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:54 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:54.859363 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d904b1a4-0aa7-44e8-b531-210d3d05fdde tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:54.988305 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d904b1a4-0aa7-44e8-b531-210d3d05fdde tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:54.992584 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c7b16edb-2511-44fd-b732-c682d2620317 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:54.992584 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c7b16edb-2511-44fd-b732-c682d2620317 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:54.996153 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c7b16edb-2511-44fd-b732-c682d2620317 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:54.996392 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d904b1a4-0aa7-44e8-b531-210d3d05fdde tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1509 microversion: 2.1 time: 0.159646 Aug 10 03:42:54.996861 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c7b16edb-2511-44fd-b732-c682d2620317 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:54.997752 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 363/738] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:54 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:54.997990 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c7b16edb-2511-44fd-b732-c682d2620317 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:54.998508 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c7b16edb-2511-44fd-b732-c682d2620317 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:55.001779 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-bf884d25-882e-4ede-8ff0-d9d2e69c8f8e req-57a41a50-27fd-40d7-8d98-fed6938fb3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c599984-f271-4886-be2f-73e7531f52e4", "name": "network-vif-plugged", "status": "completed", "tag": "54a387d8-dbe0-4a78-bbba-58f771dd4478"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:55.003463 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:42:55.003463 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:42:55.011033 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-bf884d25-882e-4ede-8ff0-d9d2e69c8f8e req-57a41a50-27fd-40d7-8d98-fed6938fb3c1 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:55.015557 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-bf884d25-882e-4ede-8ff0-d9d2e69c8f8e req-57a41a50-27fd-40d7-8d98-fed6938fb3c1 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:55.022809 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-bf884d25-882e-4ede-8ff0-d9d2e69c8f8e req-57a41a50-27fd-40d7-8d98-fed6938fb3c1 service nova] Creating event network-vif-plugged:54a387d8-dbe0-4a78-bbba-58f771dd4478 for instance 0c599984-f271-4886-be2f-73e7531f52e4 on hv-cinder-78239 Aug 10 03:42:55.029333 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-bf884d25-882e-4ede-8ff0-d9d2e69c8f8e req-57a41a50-27fd-40d7-8d98-fed6938fb3c1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029639 Aug 10 03:42:55.030373 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 364/739] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:42:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:42:55.139710 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c7b16edb-2511-44fd-b732-c682d2620317 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:55.148175 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c7b16edb-2511-44fd-b732-c682d2620317 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.164652 Aug 10 03:42:55.148764 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 376/740] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:54 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:55.163336 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4bb7f66f-9deb-43f6-9932-ee2974305efc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:55.164232 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4bb7f66f-9deb-43f6-9932-ee2974305efc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:55.170214 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4bb7f66f-9deb-43f6-9932-ee2974305efc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:55.170655 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4bb7f66f-9deb-43f6-9932-ee2974305efc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:55.171417 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4bb7f66f-9deb-43f6-9932-ee2974305efc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:55.171841 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4bb7f66f-9deb-43f6-9932-ee2974305efc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:55.183377 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1e8afb90-040e-44b1-a86e-8f476ad355bf tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a02778b0>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:55.246285 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1e8afb90-040e-44b1-a86e-8f476ad355bf tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3" status: 200 len: 346 microversion: 2.1 time: 0.070240 Aug 10 03:42:55.246861 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 377/741] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:42:55 2021] GET /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3 => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:42:55.259534 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-753ce40c-8c04-4969-a394-ea790d81697c tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Action: 'create', calling method: .version_select at 0x7f97a016b430>, body: {"snapshot": {"volume_id": "5148a58a-eb69-409c-9bcd-8a58fb00c5a3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1760195629"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:55.309680 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-4bb7f66f-9deb-43f6-9932-ee2974305efc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:55.317384 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4bb7f66f-9deb-43f6-9932-ee2974305efc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1318 microversion: 2.1 time: 0.158247 Aug 10 03:42:55.317939 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 365/742] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:55 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:55.865924 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0b5d6527-c3da-44e3-a58a-009a5436f79c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:55.866574 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0b5d6527-c3da-44e3-a58a-009a5436f79c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:55.873168 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0b5d6527-c3da-44e3-a58a-009a5436f79c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:55.873602 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0b5d6527-c3da-44e3-a58a-009a5436f79c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:55.874377 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0b5d6527-c3da-44e3-a58a-009a5436f79c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:55.874807 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0b5d6527-c3da-44e3-a58a-009a5436f79c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:55.993091 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0b5d6527-c3da-44e3-a58a-009a5436f79c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:56.001657 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0b5d6527-c3da-44e3-a58a-009a5436f79c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:56.003207 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0b5d6527-c3da-44e3-a58a-009a5436f79c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:56.010422 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0b5d6527-c3da-44e3-a58a-009a5436f79c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.142236 Aug 10 03:42:56.010422 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 366/743] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:55 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:42:56.012392 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-113cf564-2400-4a5f-a8b2-e559100be4d8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:56.013531 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-113cf564-2400-4a5f-a8b2-e559100be4d8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:56.019153 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-113cf564-2400-4a5f-a8b2-e559100be4d8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:56.019605 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-113cf564-2400-4a5f-a8b2-e559100be4d8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:56.020406 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-113cf564-2400-4a5f-a8b2-e559100be4d8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:56.020842 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-113cf564-2400-4a5f-a8b2-e559100be4d8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:56.040926 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-753ce40c-8c04-4969-a394-ea790d81697c tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.784956 Aug 10 03:42:56.042727 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 378/744] 10.222.0.21 () {60 vars in 1162 bytes} [Tue Aug 10 03:42:55 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:42:56.053164 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e3dc0e35-2156-43e1-9394-8f130f7b6443 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a00eb040>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:56.083699 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e3dc0e35-2156-43e1-9394-8f130f7b6443 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3" status: 200 len: 287 microversion: 2.1 time: 0.034480 Aug 10 03:42:56.084491 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 379/745] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 10 03:42:56 2021] GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:42:56.095965 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-4f0c1d5e-7468-4620-87ce-2c3b896f0e10 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a00eb670>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:56.134692 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-4f0c1d5e-7468-4620-87ce-2c3b896f0e10 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.044351 Aug 10 03:42:56.135256 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 380/746] 10.222.0.21 () {58 vars in 1140 bytes} [Tue Aug 10 03:42:56 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:42:56.150139 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-113cf564-2400-4a5f-a8b2-e559100be4d8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:56.150299 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-737f5033-983c-4914-81c5-5695084b9be8 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a016b430>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:56.157825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-113cf564-2400-4a5f-a8b2-e559100be4d8 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1509 microversion: 2.1 time: 0.148578 Aug 10 03:42:56.158475 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 367/747] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:56 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:56.170985 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-2b434eee-dc3f-4bd0-af5b-1ba7c3504e8d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:56.170985 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-2b434eee-dc3f-4bd0-af5b-1ba7c3504e8d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:56.171799 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2b434eee-dc3f-4bd0-af5b-1ba7c3504e8d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:56.172261 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2b434eee-dc3f-4bd0-af5b-1ba7c3504e8d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:56.173087 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2b434eee-dc3f-4bd0-af5b-1ba7c3504e8d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:56.173511 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2b434eee-dc3f-4bd0-af5b-1ba7c3504e8d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:56.182369 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-737f5033-983c-4914-81c5-5695084b9be8 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3" status: 200 len: 287 microversion: 2.1 time: 0.035538 Aug 10 03:42:56.183007 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 381/748] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 10 03:42:56 2021] GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:42:56.294863 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-2b434eee-dc3f-4bd0-af5b-1ba7c3504e8d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:56.302737 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-2b434eee-dc3f-4bd0-af5b-1ba7c3504e8d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.141456 Aug 10 03:42:56.303289 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 368/749] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:56 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:56.334289 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1bba8bbc-c81d-4878-9afc-2933dc67e8b4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:56.334878 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1bba8bbc-c81d-4878-9afc-2933dc67e8b4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:56.341112 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1bba8bbc-c81d-4878-9afc-2933dc67e8b4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:56.341574 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1bba8bbc-c81d-4878-9afc-2933dc67e8b4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:56.342322 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1bba8bbc-c81d-4878-9afc-2933dc67e8b4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:56.342742 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1bba8bbc-c81d-4878-9afc-2933dc67e8b4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:56.462483 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1bba8bbc-c81d-4878-9afc-2933dc67e8b4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:56.469674 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1bba8bbc-c81d-4878-9afc-2933dc67e8b4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1318 microversion: 2.1 time: 0.139082 Aug 10 03:42:56.470371 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 382/750] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:56 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:57.022731 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a856c479-3477-4d1d-8ddc-4f2cc2ac4232 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:57.023433 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a856c479-3477-4d1d-8ddc-4f2cc2ac4232 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:57.030289 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a856c479-3477-4d1d-8ddc-4f2cc2ac4232 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:57.030812 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a856c479-3477-4d1d-8ddc-4f2cc2ac4232 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:57.031623 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a856c479-3477-4d1d-8ddc-4f2cc2ac4232 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:57.032018 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a856c479-3477-4d1d-8ddc-4f2cc2ac4232 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:57.162082 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a856c479-3477-4d1d-8ddc-4f2cc2ac4232 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:57.170305 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a856c479-3477-4d1d-8ddc-4f2cc2ac4232 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:57.171814 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a856c479-3477-4d1d-8ddc-4f2cc2ac4232 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:57.172978 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a856c479-3477-4d1d-8ddc-4f2cc2ac4232 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.154101 Aug 10 03:42:57.173620 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 369/751] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:57 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:57.174243 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-085b1463-0577-49a4-ae67-555f3c28ac28 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:57.174854 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-085b1463-0577-49a4-ae67-555f3c28ac28 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:57.180867 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-085b1463-0577-49a4-ae67-555f3c28ac28 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:57.181316 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-085b1463-0577-49a4-ae67-555f3c28ac28 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:57.182083 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-085b1463-0577-49a4-ae67-555f3c28ac28 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:57.182520 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-085b1463-0577-49a4-ae67-555f3c28ac28 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:57.194199 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8927589d-d859-4b7d-93f6-1a69d957c838 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a015f3a0>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:57.223889 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8927589d-d859-4b7d-93f6-1a69d957c838 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3" status: 200 len: 287 microversion: 2.1 time: 0.033754 Aug 10 03:42:57.224444 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 370/752] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 10 03:42:57 2021] GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:42:57.320317 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b2ad3331-c793-4e43-ad83-ef9a995fab55 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:57.321184 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b2ad3331-c793-4e43-ad83-ef9a995fab55 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:57.323664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-085b1463-0577-49a4-ae67-555f3c28ac28 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:57.328096 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b2ad3331-c793-4e43-ad83-ef9a995fab55 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:57.328671 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b2ad3331-c793-4e43-ad83-ef9a995fab55 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:57.329588 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b2ad3331-c793-4e43-ad83-ef9a995fab55 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:57.330139 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b2ad3331-c793-4e43-ad83-ef9a995fab55 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:57.331715 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-085b1463-0577-49a4-ae67-555f3c28ac28 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1509 microversion: 2.1 time: 0.161026 Aug 10 03:42:57.332390 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 383/753] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:57 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:57.466800 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b2ad3331-c793-4e43-ad83-ef9a995fab55 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:57.474311 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b2ad3331-c793-4e43-ad83-ef9a995fab55 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.157662 Aug 10 03:42:57.475114 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 371/754] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:57 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:57.486135 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6dab39df-5192-421f-bd14-b8080e2859ba tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:57.486907 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6dab39df-5192-421f-bd14-b8080e2859ba tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:57.492837 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6dab39df-5192-421f-bd14-b8080e2859ba tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:57.493277 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6dab39df-5192-421f-bd14-b8080e2859ba tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:57.494043 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6dab39df-5192-421f-bd14-b8080e2859ba tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:57.494502 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6dab39df-5192-421f-bd14-b8080e2859ba tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:57.616889 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6dab39df-5192-421f-bd14-b8080e2859ba tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:57.625948 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6dab39df-5192-421f-bd14-b8080e2859ba tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1318 microversion: 2.1 time: 0.143670 Aug 10 03:42:57.626508 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 384/755] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:57 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:58.190525 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-01bed0d0-b12a-4ddf-a275-b88e7437e27b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:58.191138 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-01bed0d0-b12a-4ddf-a275-b88e7437e27b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:58.197193 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-01bed0d0-b12a-4ddf-a275-b88e7437e27b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:58.197651 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-01bed0d0-b12a-4ddf-a275-b88e7437e27b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:58.198433 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-01bed0d0-b12a-4ddf-a275-b88e7437e27b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:58.198870 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-01bed0d0-b12a-4ddf-a275-b88e7437e27b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:58.235380 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-fd571bf0-e4c8-44e5-99ee-2ba1dc0a7986 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a1519a60>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:58.265458 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-fd571bf0-e4c8-44e5-99ee-2ba1dc0a7986 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3" status: 200 len: 287 microversion: 2.1 time: 0.034237 Aug 10 03:42:58.269532 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 385/756] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 10 03:42:58 2021] GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:42:58.342995 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-01bed0d0-b12a-4ddf-a275-b88e7437e27b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:58.348170 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-4d8c2500-fcfc-46af-bfb9-e237c38f70f1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:58.348798 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-4d8c2500-fcfc-46af-bfb9-e237c38f70f1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:58.351499 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-01bed0d0-b12a-4ddf-a275-b88e7437e27b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:58.355152 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-01bed0d0-b12a-4ddf-a275-b88e7437e27b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:58.355152 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-01bed0d0-b12a-4ddf-a275-b88e7437e27b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.167328 Aug 10 03:42:58.355374 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4d8c2500-fcfc-46af-bfb9-e237c38f70f1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:58.355530 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 372/757] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:58 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:58.355633 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4d8c2500-fcfc-46af-bfb9-e237c38f70f1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:58.355633 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4d8c2500-fcfc-46af-bfb9-e237c38f70f1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:58.356066 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4d8c2500-fcfc-46af-bfb9-e237c38f70f1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:58.479703 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4d8c2500-fcfc-46af-bfb9-e237c38f70f1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:58.488441 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-4d8c2500-fcfc-46af-bfb9-e237c38f70f1 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1509 microversion: 2.1 time: 0.143661 Aug 10 03:42:58.489234 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 386/758] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:58 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1509 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:58.493913 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0f7a5f5d-dc6a-49ed-96c3-655bdea7c819 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:58.494626 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0f7a5f5d-dc6a-49ed-96c3-655bdea7c819 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:58.501531 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f7a5f5d-dc6a-49ed-96c3-655bdea7c819 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:58.502061 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f7a5f5d-dc6a-49ed-96c3-655bdea7c819 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:58.502905 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f7a5f5d-dc6a-49ed-96c3-655bdea7c819 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:58.503531 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f7a5f5d-dc6a-49ed-96c3-655bdea7c819 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:58.545499 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-3c0eec21-282a-4285-8009-e85d3af90e94 req-34b3c78d-8d93-4405-8531-72e5e3eb8438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc93e7b-20ee-49c2-8f30-c97c884a1118", "name": "network-vif-plugged", "status": "completed", "tag": "096af4bc-acc2-42b7-8512-7a1b982bef27"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:42:58.547922 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:42:58.547922 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:42:58.556035 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-3c0eec21-282a-4285-8009-e85d3af90e94 req-34b3c78d-8d93-4405-8531-72e5e3eb8438 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:58.556762 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-3c0eec21-282a-4285-8009-e85d3af90e94 req-34b3c78d-8d93-4405-8531-72e5e3eb8438 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:58.569497 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-3c0eec21-282a-4285-8009-e85d3af90e94 req-34b3c78d-8d93-4405-8531-72e5e3eb8438 service nova] Creating event network-vif-plugged:096af4bc-acc2-42b7-8512-7a1b982bef27 for instance 1dc93e7b-20ee-49c2-8f30-c97c884a1118 on hv-cinder-78239 Aug 10 03:42:58.575013 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-3c0eec21-282a-4285-8009-e85d3af90e94 req-34b3c78d-8d93-4405-8531-72e5e3eb8438 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033800 Aug 10 03:42:58.576427 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 387/759] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:42:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:42:58.634287 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0f7a5f5d-dc6a-49ed-96c3-655bdea7c819 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:58.642668 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0f7a5f5d-dc6a-49ed-96c3-655bdea7c819 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.154201 Aug 10 03:42:58.642958 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3a318227-113e-44ad-832e-1667dc58a1c9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:58.643589 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 373/760] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:58 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:42:58.643705 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3a318227-113e-44ad-832e-1667dc58a1c9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:58.650288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a318227-113e-44ad-832e-1667dc58a1c9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:58.650629 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a318227-113e-44ad-832e-1667dc58a1c9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:58.651398 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a318227-113e-44ad-832e-1667dc58a1c9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:58.651828 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a318227-113e-44ad-832e-1667dc58a1c9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:58.779720 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3a318227-113e-44ad-832e-1667dc58a1c9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:58.786944 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3a318227-113e-44ad-832e-1667dc58a1c9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1318 microversion: 2.1 time: 0.147961 Aug 10 03:42:58.787510 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 388/761] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:58 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:59.276991 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a5f22846-3aea-42a9-ab34-20bbc4177a25 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a02b53a0>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:59.306050 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a5f22846-3aea-42a9-ab34-20bbc4177a25 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3" status: 200 len: 287 microversion: 2.1 time: 0.032629 Aug 10 03:42:59.306605 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 374/762] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 10 03:42:59 2021] GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:42:59.373578 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-83f6a56c-b00e-4fca-83ab-7cb6b8a74c8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:59.374219 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-83f6a56c-b00e-4fca-83ab-7cb6b8a74c8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:59.380539 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-83f6a56c-b00e-4fca-83ab-7cb6b8a74c8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:59.381320 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-83f6a56c-b00e-4fca-83ab-7cb6b8a74c8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:59.382385 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-83f6a56c-b00e-4fca-83ab-7cb6b8a74c8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:59.383026 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-83f6a56c-b00e-4fca-83ab-7cb6b8a74c8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:59.504799 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b19df390-b1f0-407b-a9d0-af865bf2a481 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:59.505701 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b19df390-b1f0-407b-a9d0-af865bf2a481 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:59.510362 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-83f6a56c-b00e-4fca-83ab-7cb6b8a74c8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:59.515322 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b19df390-b1f0-407b-a9d0-af865bf2a481 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:59.515774 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b19df390-b1f0-407b-a9d0-af865bf2a481 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:59.516605 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b19df390-b1f0-407b-a9d0-af865bf2a481 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:59.517088 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b19df390-b1f0-407b-a9d0-af865bf2a481 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:59.520376 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-83f6a56c-b00e-4fca-83ab-7cb6b8a74c8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:59.521866 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-83f6a56c-b00e-4fca-83ab-7cb6b8a74c8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:59.523002 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-83f6a56c-b00e-4fca-83ab-7cb6b8a74c8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.153873 Aug 10 03:42:59.524065 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 389/763] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:42:59 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:42:59.659780 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c0fe8877-a1f1-4e7e-9cff-f48e80fe1bdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:59.660433 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c0fe8877-a1f1-4e7e-9cff-f48e80fe1bdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:59.666972 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c0fe8877-a1f1-4e7e-9cff-f48e80fe1bdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:59.667451 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c0fe8877-a1f1-4e7e-9cff-f48e80fe1bdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:59.668331 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c0fe8877-a1f1-4e7e-9cff-f48e80fe1bdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:59.668660 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c0fe8877-a1f1-4e7e-9cff-f48e80fe1bdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:59.721247 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b19df390-b1f0-407b-a9d0-af865bf2a481 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:59.729514 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b19df390-b1f0-407b-a9d0-af865bf2a481 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1509 microversion: 2.1 time: 0.227682 Aug 10 03:42:59.735134 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 375/764] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:59 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:59.790640 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c0fe8877-a1f1-4e7e-9cff-f48e80fe1bdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:59.797969 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c0fe8877-a1f1-4e7e-9cff-f48e80fe1bdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.141864 Aug 10 03:42:59.802927 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1b1f6ae8-f14f-4145-9398-5aa56444e132 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:42:59.803549 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1b1f6ae8-f14f-4145-9398-5aa56444e132 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:42:59.807109 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 390/765] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:59 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:42:59.810233 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1b1f6ae8-f14f-4145-9398-5aa56444e132 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:59.810684 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1b1f6ae8-f14f-4145-9398-5aa56444e132 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:59.811488 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1b1f6ae8-f14f-4145-9398-5aa56444e132 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:42:59.811916 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1b1f6ae8-f14f-4145-9398-5aa56444e132 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:42:59.947617 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1b1f6ae8-f14f-4145-9398-5aa56444e132 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:42:59.955393 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1b1f6ae8-f14f-4145-9398-5aa56444e132 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1318 microversion: 2.1 time: 0.156503 Aug 10 03:42:59.963725 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 376/766] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:42:59 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:43:00.086222 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-7acb7e6a-30d6-4044-8130-5024348fb98d req-38e6f959-7ead-4328-b494-fc221f355de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280754b9-5f91-4b9c-a00e-59a052eaab43", "name": "network-vif-deleted", "tag": "b8c15eaf-d642-44fa-8a94-a34fbb169d00"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:43:00.087786 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:43:00.087786 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:43:00.095087 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-7acb7e6a-30d6-4044-8130-5024348fb98d req-38e6f959-7ead-4328-b494-fc221f355de2 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:00.095522 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-7acb7e6a-30d6-4044-8130-5024348fb98d req-38e6f959-7ead-4328-b494-fc221f355de2 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:00.106207 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-7acb7e6a-30d6-4044-8130-5024348fb98d req-38e6f959-7ead-4328-b494-fc221f355de2 service nova] Creating event network-vif-deleted:b8c15eaf-d642-44fa-8a94-a34fbb169d00 for instance 280754b9-5f91-4b9c-a00e-59a052eaab43 on hv-cinder-78239 Aug 10 03:43:00.111289 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-7acb7e6a-30d6-4044-8130-5024348fb98d req-38e6f959-7ead-4328-b494-fc221f355de2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028616 Aug 10 03:43:00.112053 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 391/767] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:43:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:43:00.317381 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4fe6c5bb-f15c-4c4b-b4a0-724b9cb2b696 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a02b5790>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:00.348595 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4fe6c5bb-f15c-4c4b-b4a0-724b9cb2b696 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3" status: 200 len: 288 microversion: 2.1 time: 0.034674 Aug 10 03:43:00.349375 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 377/768] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 10 03:43:00 2021] GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:43:00.360743 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-228c7a74-1c47-4bcc-8987-746373491165 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a1f27040>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:00.491919 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-228c7a74-1c47-4bcc-8987-746373491165 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "DELETE /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3" status: 202 len: 0 microversion: 2.1 time: 0.135807 Aug 10 03:43:00.492577 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 392/769] 10.222.0.21 () {58 vars in 1254 bytes} [Tue Aug 10 03:43:00 2021] DELETE /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:43:00.500937 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d3a86a57-c8c9-4ea7-bb68-73ee36f32ac3 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a14e78b0>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:00.543684 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d3a86a57-c8c9-4ea7-bb68-73ee36f32ac3 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3" status: 200 len: 287 microversion: 2.1 time: 0.034563 Aug 10 03:43:00.543684 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 378/770] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 10 03:43:00 2021] GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:43:00.546067 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-62ffdf43-7027-445a-94a5-17e91c1daaef tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:00.547120 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-62ffdf43-7027-445a-94a5-17e91c1daaef tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:00.553421 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-62ffdf43-7027-445a-94a5-17e91c1daaef tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:00.553861 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-62ffdf43-7027-445a-94a5-17e91c1daaef tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:00.554626 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-62ffdf43-7027-445a-94a5-17e91c1daaef tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:00.555052 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-62ffdf43-7027-445a-94a5-17e91c1daaef tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:00.692299 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-62ffdf43-7027-445a-94a5-17e91c1daaef tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:00.700903 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-62ffdf43-7027-445a-94a5-17e91c1daaef tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:00.702420 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-62ffdf43-7027-445a-94a5-17e91c1daaef tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:00.703538 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-62ffdf43-7027-445a-94a5-17e91c1daaef tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.165000 Aug 10 03:43:00.704119 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 393/771] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:43:00 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:43:00.745984 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d9dfe8e7-8340-422b-96f3-5f4eaa22486c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:00.746583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d9dfe8e7-8340-422b-96f3-5f4eaa22486c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:00.754157 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d9dfe8e7-8340-422b-96f3-5f4eaa22486c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:00.754608 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d9dfe8e7-8340-422b-96f3-5f4eaa22486c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:00.755456 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d9dfe8e7-8340-422b-96f3-5f4eaa22486c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:00.755893 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d9dfe8e7-8340-422b-96f3-5f4eaa22486c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:00.786589 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d9dfe8e7-8340-422b-96f3-5f4eaa22486c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:00.787031 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d9dfe8e7-8340-422b-96f3-5f4eaa22486c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:00.787479 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-d9dfe8e7-8340-422b-96f3-5f4eaa22486c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lazy-loading 'fault' on Instance uuid 280754b9-5f91-4b9c-a00e-59a052eaab43 {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:43:00.814324 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f9db5bb9-032a-40c1-b350-958894e85ea6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:00.815017 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f9db5bb9-032a-40c1-b350-958894e85ea6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:00.820844 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f9db5bb9-032a-40c1-b350-958894e85ea6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:00.821284 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f9db5bb9-032a-40c1-b350-958894e85ea6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:00.822045 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f9db5bb9-032a-40c1-b350-958894e85ea6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:00.822473 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f9db5bb9-032a-40c1-b350-958894e85ea6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:00.826356 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d9dfe8e7-8340-422b-96f3-5f4eaa22486c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:00.833471 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d9dfe8e7-8340-422b-96f3-5f4eaa22486c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1312 microversion: 2.1 time: 0.091802 Aug 10 03:43:00.834035 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 379/772] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:00 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1312 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:00.943305 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f9db5bb9-032a-40c1-b350-958894e85ea6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:00.951620 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f9db5bb9-032a-40c1-b350-958894e85ea6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.141063 Aug 10 03:43:00.952167 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 394/773] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:00 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:43:00.972561 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b6f9b078-429c-440e-983e-85cc85d641c8 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:00.973212 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b6f9b078-429c-440e-983e-85cc85d641c8 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:00.979034 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b6f9b078-429c-440e-983e-85cc85d641c8 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:00.979463 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b6f9b078-429c-440e-983e-85cc85d641c8 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:00.980287 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b6f9b078-429c-440e-983e-85cc85d641c8 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:00.980720 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b6f9b078-429c-440e-983e-85cc85d641c8 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:01.107575 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b6f9b078-429c-440e-983e-85cc85d641c8 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:01.115735 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b6f9b078-429c-440e-983e-85cc85d641c8 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1318 microversion: 2.1 time: 0.146928 Aug 10 03:43:01.116325 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 380/774] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:00 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:01.554879 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f77ad038-2098-44fe-8353-1a48a421b577 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a0138310>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:01.580727 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-f77ad038-2098-44fe-8353-1a48a421b577 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] HTTP exception thrown: Snapshot a5ddbbff-2f7b-445b-9503-b4524f134bb3 could not be found. Aug 10 03:43:01.581496 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f77ad038-2098-44fe-8353-1a48a421b577 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Returning 404 to user: Snapshot a5ddbbff-2f7b-445b-9503-b4524f134bb3 could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:43:01.582363 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f77ad038-2098-44fe-8353-1a48a421b577 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3" status: 404 len: 111 microversion: 2.1 time: 0.032295 Aug 10 03:43:01.582925 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 395/775] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 10 03:43:01 2021] GET /compute/v2.1/os-snapshots/a5ddbbff-2f7b-445b-9503-b4524f134bb3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:43:01.591010 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-43beee4c-a529-4543-b1cb-ab88efb3ebd7 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a14e7940>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:01.722150 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-64e30aa7-0ed7-4a7b-ad3f-f947d62bf9ee tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:01.722764 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-64e30aa7-0ed7-4a7b-ad3f-f947d62bf9ee tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:01.729747 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-64e30aa7-0ed7-4a7b-ad3f-f947d62bf9ee tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:01.730191 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-64e30aa7-0ed7-4a7b-ad3f-f947d62bf9ee tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:01.730955 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-64e30aa7-0ed7-4a7b-ad3f-f947d62bf9ee tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:01.731386 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-64e30aa7-0ed7-4a7b-ad3f-f947d62bf9ee tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:01.850563 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-64e30aa7-0ed7-4a7b-ad3f-f947d62bf9ee tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:01.859457 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-64e30aa7-0ed7-4a7b-ad3f-f947d62bf9ee tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:01.860963 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-64e30aa7-0ed7-4a7b-ad3f-f947d62bf9ee tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:01.862076 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-64e30aa7-0ed7-4a7b-ad3f-f947d62bf9ee tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.143756 Aug 10 03:43:01.862611 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 396/776] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:43:01 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:43:01.866756 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a7e2216a-ac4d-48ac-bd5f-cd6f5de9ff0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:01.867344 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a7e2216a-ac4d-48ac-bd5f-cd6f5de9ff0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:01.874111 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a7e2216a-ac4d-48ac-bd5f-cd6f5de9ff0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:01.874559 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a7e2216a-ac4d-48ac-bd5f-cd6f5de9ff0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:01.876306 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a7e2216a-ac4d-48ac-bd5f-cd6f5de9ff0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:01.876306 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a7e2216a-ac4d-48ac-bd5f-cd6f5de9ff0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:01.907351 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a7e2216a-ac4d-48ac-bd5f-cd6f5de9ff0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:01.907838 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a7e2216a-ac4d-48ac-bd5f-cd6f5de9ff0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:01.908307 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-a7e2216a-ac4d-48ac-bd5f-cd6f5de9ff0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lazy-loading 'fault' on Instance uuid 280754b9-5f91-4b9c-a00e-59a052eaab43 {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:43:01.947018 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a7e2216a-ac4d-48ac-bd5f-cd6f5de9ff0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:01.955950 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a7e2216a-ac4d-48ac-bd5f-cd6f5de9ff0b tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1312 microversion: 2.1 time: 0.092395 Aug 10 03:43:01.956548 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 397/777] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:01 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1312 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:01.967820 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-75a424c3-b23a-4b01-89b7-3280af695dc9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:01.968483 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-75a424c3-b23a-4b01-89b7-3280af695dc9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:01.974555 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-75a424c3-b23a-4b01-89b7-3280af695dc9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:01.974998 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-75a424c3-b23a-4b01-89b7-3280af695dc9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:01.975768 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-75a424c3-b23a-4b01-89b7-3280af695dc9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:01.976335 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-75a424c3-b23a-4b01-89b7-3280af695dc9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:01.993893 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-43beee4c-a529-4543-b1cb-ab88efb3ebd7 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3" status: 202 len: 0 microversion: 2.1 time: 0.406502 Aug 10 03:43:01.998421 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 381/778] 10.222.0.21 () {58 vars in 1248 bytes} [Tue Aug 10 03:43:01 2021] DELETE /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:43:02.003576 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0185f897-4e88-41a0-bae9-a78cbdf8ef77 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a01423a0>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:02.058068 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0185f897-4e88-41a0-bae9-a78cbdf8ef77 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3" status: 200 len: 345 microversion: 2.1 time: 0.058203 Aug 10 03:43:02.058700 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 382/779] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:43:01 2021] GET /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:43:02.109575 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-75a424c3-b23a-4b01-89b7-3280af695dc9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:02.117431 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-75a424c3-b23a-4b01-89b7-3280af695dc9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.153018 Aug 10 03:43:02.118587 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 398/780] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:01 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:02.132190 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6942a3db-f6cd-4d09-8c53-d5eb8d19c00b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:02.132830 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6942a3db-f6cd-4d09-8c53-d5eb8d19c00b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:02.140091 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6942a3db-f6cd-4d09-8c53-d5eb8d19c00b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:02.140551 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6942a3db-f6cd-4d09-8c53-d5eb8d19c00b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:02.141317 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6942a3db-f6cd-4d09-8c53-d5eb8d19c00b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:02.141738 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6942a3db-f6cd-4d09-8c53-d5eb8d19c00b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:02.256749 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6942a3db-f6cd-4d09-8c53-d5eb8d19c00b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:02.264498 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6942a3db-f6cd-4d09-8c53-d5eb8d19c00b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1506 microversion: 2.1 time: 0.135924 Aug 10 03:43:02.265049 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 383/781] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:02 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1506 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:02.880721 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b33bdc73-d234-45a1-89d7-9138ac774332 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:02.881343 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b33bdc73-d234-45a1-89d7-9138ac774332 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:02.886918 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b33bdc73-d234-45a1-89d7-9138ac774332 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:02.887408 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b33bdc73-d234-45a1-89d7-9138ac774332 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:02.888773 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b33bdc73-d234-45a1-89d7-9138ac774332 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:02.889205 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b33bdc73-d234-45a1-89d7-9138ac774332 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:02.971825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-904a2e09-2378-4a58-82e1-e9dd36009f4e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:02.972463 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-904a2e09-2378-4a58-82e1-e9dd36009f4e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:02.978483 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-904a2e09-2378-4a58-82e1-e9dd36009f4e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:02.978923 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-904a2e09-2378-4a58-82e1-e9dd36009f4e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:02.979691 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-904a2e09-2378-4a58-82e1-e9dd36009f4e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:02.980344 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-904a2e09-2378-4a58-82e1-e9dd36009f4e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:03.011828 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b33bdc73-d234-45a1-89d7-9138ac774332 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:03.012559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-904a2e09-2378-4a58-82e1-e9dd36009f4e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:03.012999 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-904a2e09-2378-4a58-82e1-e9dd36009f4e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:03.013488 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-904a2e09-2378-4a58-82e1-e9dd36009f4e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lazy-loading 'fault' on Instance uuid 280754b9-5f91-4b9c-a00e-59a052eaab43 {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:43:03.020271 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b33bdc73-d234-45a1-89d7-9138ac774332 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:03.021798 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b33bdc73-d234-45a1-89d7-9138ac774332 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:03.022969 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b33bdc73-d234-45a1-89d7-9138ac774332 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.146097 Aug 10 03:43:03.023528 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 399/782] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:43:02 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:43:03.056888 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-904a2e09-2378-4a58-82e1-e9dd36009f4e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:03.064838 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-904a2e09-2378-4a58-82e1-e9dd36009f4e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1312 microversion: 2.1 time: 0.096604 Aug 10 03:43:03.065577 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 384/783] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:02 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:43:03.077370 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-204f3945-a9f6-4caa-ac9a-72cf23bd9072 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a016b790>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:03.133943 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4687ee3f-7186-45da-9107-50ef0341eb9e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:03.134743 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4687ee3f-7186-45da-9107-50ef0341eb9e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:03.136483 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-204f3945-a9f6-4caa-ac9a-72cf23bd9072 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3" status: 200 len: 345 microversion: 2.1 time: 0.064580 Aug 10 03:43:03.142219 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 400/784] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:43:03 2021] GET /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:43:03.147446 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4687ee3f-7186-45da-9107-50ef0341eb9e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:03.148183 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4687ee3f-7186-45da-9107-50ef0341eb9e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:03.148364 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4687ee3f-7186-45da-9107-50ef0341eb9e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:03.149055 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4687ee3f-7186-45da-9107-50ef0341eb9e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:03.281193 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-4687ee3f-7186-45da-9107-50ef0341eb9e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:03.288920 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4687ee3f-7186-45da-9107-50ef0341eb9e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.158633 Aug 10 03:43:03.289482 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 385/785] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:03 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:04.041865 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a63ce3a2-79f6-46ee-9ad0-dbae045d5ed1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:04.042474 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a63ce3a2-79f6-46ee-9ad0-dbae045d5ed1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:04.048882 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a63ce3a2-79f6-46ee-9ad0-dbae045d5ed1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:04.049327 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a63ce3a2-79f6-46ee-9ad0-dbae045d5ed1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:04.050082 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a63ce3a2-79f6-46ee-9ad0-dbae045d5ed1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:04.050510 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a63ce3a2-79f6-46ee-9ad0-dbae045d5ed1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:04.082250 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-17cb57fd-2c06-4c0f-93a2-914186ac8878 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:04.083482 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-17cb57fd-2c06-4c0f-93a2-914186ac8878 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:04.090395 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-17cb57fd-2c06-4c0f-93a2-914186ac8878 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:04.091325 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-17cb57fd-2c06-4c0f-93a2-914186ac8878 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:04.092105 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-17cb57fd-2c06-4c0f-93a2-914186ac8878 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:04.092554 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-17cb57fd-2c06-4c0f-93a2-914186ac8878 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:04.123899 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-17cb57fd-2c06-4c0f-93a2-914186ac8878 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:04.124383 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-17cb57fd-2c06-4c0f-93a2-914186ac8878 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:04.124862 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-17cb57fd-2c06-4c0f-93a2-914186ac8878 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lazy-loading 'fault' on Instance uuid 280754b9-5f91-4b9c-a00e-59a052eaab43 {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:43:04.168424 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-17cb57fd-2c06-4c0f-93a2-914186ac8878 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:04.180484 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a63ce3a2-79f6-46ee-9ad0-dbae045d5ed1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:04.183866 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-17cb57fd-2c06-4c0f-93a2-914186ac8878 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 200 len: 1312 microversion: 2.1 time: 0.099243 Aug 10 03:43:04.188807 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a63ce3a2-79f6-46ee-9ad0-dbae045d5ed1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:04.189297 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 386/786] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:04 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:43:04.190296 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a63ce3a2-79f6-46ee-9ad0-dbae045d5ed1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:04.191421 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a63ce3a2-79f6-46ee-9ad0-dbae045d5ed1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1808 microversion: 2.20 time: 0.153286 Aug 10 03:43:04.192114 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 401/787] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:43:04 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:43:04.195989 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-79dc5788-d2fe-404c-8212-2632788374e1 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a0463160>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:04.245680 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-79dc5788-d2fe-404c-8212-2632788374e1 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3" status: 200 len: 345 microversion: 2.1 time: 0.053205 Aug 10 03:43:04.246244 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 387/788] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:43:04 2021] GET /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:43:04.306596 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-4ccea075-a695-4000-933a-76cad960df75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:04.307197 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-4ccea075-a695-4000-933a-76cad960df75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:04.313629 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4ccea075-a695-4000-933a-76cad960df75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:04.314068 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4ccea075-a695-4000-933a-76cad960df75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:04.314828 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4ccea075-a695-4000-933a-76cad960df75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:04.315243 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4ccea075-a695-4000-933a-76cad960df75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:04.442199 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4ccea075-a695-4000-933a-76cad960df75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:04.449418 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-4ccea075-a695-4000-933a-76cad960df75 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.146425 Aug 10 03:43:04.449975 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 402/789] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:04 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:04.659577 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-77eb0a7d-d0ee-438e-9a71-73bda065392b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:04.660107 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-77eb0a7d-d0ee-438e-9a71-73bda065392b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:04.666230 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-77eb0a7d-d0ee-438e-9a71-73bda065392b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:04.672421 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-77eb0a7d-d0ee-438e-9a71-73bda065392b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:04.672421 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-77eb0a7d-d0ee-438e-9a71-73bda065392b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:04.672421 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-77eb0a7d-d0ee-438e-9a71-73bda065392b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:04.763925 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-77eb0a7d-d0ee-438e-9a71-73bda065392b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lazy-loading 'services' on Instance uuid 8b3a59e0-96ca-48a8-a62f-c6fef743ce89 {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:43:05.205737 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f908236a-95b9-418d-a2c0-7664212d7bba tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:05.206613 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f908236a-95b9-418d-a2c0-7664212d7bba tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: 280754b9-5f91-4b9c-a00e-59a052eaab43] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:05.220634 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f908236a-95b9-418d-a2c0-7664212d7bba tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:05.221219 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f908236a-95b9-418d-a2c0-7664212d7bba tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:05.222013 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f908236a-95b9-418d-a2c0-7664212d7bba tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:05.222447 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f908236a-95b9-418d-a2c0-7664212d7bba tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:05.236414 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-f908236a-95b9-418d-a2c0-7664212d7bba tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] HTTP exception thrown: Instance 280754b9-5f91-4b9c-a00e-59a052eaab43 could not be found. Aug 10 03:43:05.236997 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f908236a-95b9-418d-a2c0-7664212d7bba tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Returning 404 to user: Instance 280754b9-5f91-4b9c-a00e-59a052eaab43 could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:43:05.237835 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f908236a-95b9-418d-a2c0-7664212d7bba tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43" status: 404 len: 111 microversion: 2.1 time: 0.036289 Aug 10 03:43:05.238362 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 403/790] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:05 2021] GET /compute/v2.1/servers/280754b9-5f91-4b9c-a00e-59a052eaab43 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:43:05.242595 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-bcf60fce-a82c-4f8e-864a-e8142b3c78b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:05.243188 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-bcf60fce-a82c-4f8e-864a-e8142b3c78b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:05.248709 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bcf60fce-a82c-4f8e-864a-e8142b3c78b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:05.249218 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bcf60fce-a82c-4f8e-864a-e8142b3c78b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:05.250122 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bcf60fce-a82c-4f8e-864a-e8142b3c78b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:05.250489 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bcf60fce-a82c-4f8e-864a-e8142b3c78b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:05.373997 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bcf60fce-a82c-4f8e-864a-e8142b3c78b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:05.382594 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bcf60fce-a82c-4f8e-864a-e8142b3c78b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:05.384089 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bcf60fce-a82c-4f8e-864a-e8142b3c78b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:05.385261 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-bcf60fce-a82c-4f8e-864a-e8142b3c78b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1795 microversion: 2.20 time: 0.145972 Aug 10 03:43:05.385798 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 404/791] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:43:05 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1795 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:43:05.390456 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-acfb4855-6db9-4995-85ca-f7c22d13a21a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:05.390944 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-acfb4855-6db9-4995-85ca-f7c22d13a21a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:05.396787 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-acfb4855-6db9-4995-85ca-f7c22d13a21a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:05.397238 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-acfb4855-6db9-4995-85ca-f7c22d13a21a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:05.398004 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-acfb4855-6db9-4995-85ca-f7c22d13a21a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:05.398440 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-acfb4855-6db9-4995-85ca-f7c22d13a21a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:05.424866 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-acfb4855-6db9-4995-85ca-f7c22d13a21a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Going to try to terminate instance {{(pid=108439) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:43:05.468211 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-77eb0a7d-d0ee-438e-9a71-73bda065392b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "DELETE /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/os-volume_attachments/b61b8f92-1f16-4425-a3f6-32026f1f8a6a" status: 202 len: 0 microversion: 2.1 time: 0.812226 Aug 10 03:43:05.469042 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 388/792] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 10 03:43:04 2021] DELETE /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/os-volume_attachments/b61b8f92-1f16-4425-a3f6-32026f1f8a6a => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:43:05.474602 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-2e9b5288-63a6-46f9-905d-f4008c3df7ea tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a02b5790>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:05.539047 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-2e9b5288-63a6-46f9-905d-f4008c3df7ea tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] HTTP exception thrown: Volume 5148a58a-eb69-409c-9bcd-8a58fb00c5a3 could not be found. Aug 10 03:43:05.539690 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-2e9b5288-63a6-46f9-905d-f4008c3df7ea tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Returning 404 to user: Volume 5148a58a-eb69-409c-9bcd-8a58fb00c5a3 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:43:05.540804 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-2e9b5288-63a6-46f9-905d-f4008c3df7ea tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3" status: 404 len: 109 microversion: 2.1 time: 0.070421 Aug 10 03:43:05.541496 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 389/793] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:43:05 2021] GET /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:43:05.545898 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a1704e5a-1770-4b60-98e1-a955f7013cdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:05.546678 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a1704e5a-1770-4b60-98e1-a955f7013cdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:05.553326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a1704e5a-1770-4b60-98e1-a955f7013cdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:05.553764 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a1704e5a-1770-4b60-98e1-a955f7013cdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:05.554526 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a1704e5a-1770-4b60-98e1-a955f7013cdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:05.554949 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a1704e5a-1770-4b60-98e1-a955f7013cdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:05.679143 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a1704e5a-1770-4b60-98e1-a955f7013cdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:05.687045 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a1704e5a-1770-4b60-98e1-a955f7013cdb tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.144619 Aug 10 03:43:05.687697 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 390/794] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:05 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:05.691948 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c89c6974-3288-40b1-8016-e7948c3f0cc8 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a01b41f0>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:05.718656 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-c89c6974-3288-40b1-8016-e7948c3f0cc8 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] HTTP exception thrown: Volume 5148a58a-eb69-409c-9bcd-8a58fb00c5a3 could not be found. Aug 10 03:43:05.719250 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c89c6974-3288-40b1-8016-e7948c3f0cc8 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Returning 404 to user: Volume 5148a58a-eb69-409c-9bcd-8a58fb00c5a3 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:43:05.725371 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c89c6974-3288-40b1-8016-e7948c3f0cc8 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3" status: 404 len: 109 microversion: 2.1 time: 0.031506 Aug 10 03:43:05.725371 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 391/795] 10.222.0.21 () {58 vars in 1248 bytes} [Tue Aug 10 03:43:05 2021] DELETE /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:43:05.731524 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e91dfb87-5168-4da8-9708-6a5cd8c4e878 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Calling method '.version_select at 0x7f97a015ff70>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:05.759146 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-e91dfb87-5168-4da8-9708-6a5cd8c4e878 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] HTTP exception thrown: Volume 5148a58a-eb69-409c-9bcd-8a58fb00c5a3 could not be found. Aug 10 03:43:05.759731 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e91dfb87-5168-4da8-9708-6a5cd8c4e878 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] Returning 404 to user: Volume 5148a58a-eb69-409c-9bcd-8a58fb00c5a3 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:43:05.760570 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e91dfb87-5168-4da8-9708-6a5cd8c4e878 tempest-VolumesSnapshotsTestJSON-968330787 tempest-VolumesSnapshotsTestJSON-968330787-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3" status: 404 len: 109 microversion: 2.1 time: 0.032447 Aug 10 03:43:05.761097 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 392/796] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:43:05 2021] GET /compute/v2.1/os-volumes/5148a58a-eb69-409c-9bcd-8a58fb00c5a3 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 03:43:06.004665 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-acfb4855-6db9-4995-85ca-f7c22d13a21a tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 204 len: 0 microversion: 2.1 time: 0.617528 Aug 10 03:43:06.005561 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 405/797] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:43:05 2021] DELETE /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:43:06.013253 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f48f1e63-9078-4faf-b28f-800d74eded82 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:06.014017 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f48f1e63-9078-4faf-b28f-800d74eded82 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:06.020249 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f48f1e63-9078-4faf-b28f-800d74eded82 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:06.020705 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f48f1e63-9078-4faf-b28f-800d74eded82 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:06.021527 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f48f1e63-9078-4faf-b28f-800d74eded82 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:06.021950 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f48f1e63-9078-4faf-b28f-800d74eded82 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:06.149357 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f48f1e63-9078-4faf-b28f-800d74eded82 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:06.157261 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f48f1e63-9078-4faf-b28f-800d74eded82 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.147687 Aug 10 03:43:06.157810 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 393/798] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:06 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:43:06.545616 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-43e23d4e-9525-4954-adfa-00bbed64c72b req-5b808211-f8f2-4fa1-b48a-0f7347a99f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a89090-7d79-496b-878d-213d6f48b970", "name": "network-vif-plugged", "status": "completed", "tag": "6f883b5b-35b9-44d5-8f3d-ba0bf7b04925"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:43:06.547251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:43:06.547251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:43:06.554236 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-43e23d4e-9525-4954-adfa-00bbed64c72b req-5b808211-f8f2-4fa1-b48a-0f7347a99f80 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:06.554668 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-43e23d4e-9525-4954-adfa-00bbed64c72b req-5b808211-f8f2-4fa1-b48a-0f7347a99f80 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:06.569944 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-43e23d4e-9525-4954-adfa-00bbed64c72b req-5b808211-f8f2-4fa1-b48a-0f7347a99f80 service nova] Creating event network-vif-plugged:6f883b5b-35b9-44d5-8f3d-ba0bf7b04925 for instance 43a89090-7d79-496b-878d-213d6f48b970 on hv-cinder-78239 Aug 10 03:43:06.574778 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-43e23d4e-9525-4954-adfa-00bbed64c72b req-5b808211-f8f2-4fa1-b48a-0f7347a99f80 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033814 Aug 10 03:43:06.576743 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 406/799] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:43:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:43:06.702975 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ea27e5da-7674-443c-a8d9-a237c5fd8acc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:06.703586 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ea27e5da-7674-443c-a8d9-a237c5fd8acc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:06.709386 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ea27e5da-7674-443c-a8d9-a237c5fd8acc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:06.709828 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ea27e5da-7674-443c-a8d9-a237c5fd8acc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:06.710596 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ea27e5da-7674-443c-a8d9-a237c5fd8acc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:06.711023 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ea27e5da-7674-443c-a8d9-a237c5fd8acc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:06.847993 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ea27e5da-7674-443c-a8d9-a237c5fd8acc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:06.855211 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ea27e5da-7674-443c-a8d9-a237c5fd8acc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.155903 Aug 10 03:43:06.857062 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 394/800] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:06 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:07.174576 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3a427bfd-484e-4b2d-9e5a-78ea0b2b19b0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:07.175538 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3a427bfd-484e-4b2d-9e5a-78ea0b2b19b0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:07.182084 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a427bfd-484e-4b2d-9e5a-78ea0b2b19b0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:07.182528 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a427bfd-484e-4b2d-9e5a-78ea0b2b19b0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:07.183429 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a427bfd-484e-4b2d-9e5a-78ea0b2b19b0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:07.183864 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a427bfd-484e-4b2d-9e5a-78ea0b2b19b0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:07.317152 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3a427bfd-484e-4b2d-9e5a-78ea0b2b19b0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:07.324348 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3a427bfd-484e-4b2d-9e5a-78ea0b2b19b0 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.153790 Aug 10 03:43:07.335490 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 407/801] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:07 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:07.875225 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4d9f8916-e94c-4162-bb87-8d6c6d50228e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:07.875905 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4d9f8916-e94c-4162-bb87-8d6c6d50228e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:07.881675 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4d9f8916-e94c-4162-bb87-8d6c6d50228e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:07.882120 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4d9f8916-e94c-4162-bb87-8d6c6d50228e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:07.882921 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4d9f8916-e94c-4162-bb87-8d6c6d50228e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:07.883348 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4d9f8916-e94c-4162-bb87-8d6c6d50228e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:08.008290 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-4d9f8916-e94c-4162-bb87-8d6c6d50228e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:08.016149 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4d9f8916-e94c-4162-bb87-8d6c6d50228e tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.145160 Aug 10 03:43:08.016738 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 395/802] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:07 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:08.343070 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-54a62ae9-b5b4-4c9f-8c23-6c286264493f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:08.343675 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-54a62ae9-b5b4-4c9f-8c23-6c286264493f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:08.350580 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54a62ae9-b5b4-4c9f-8c23-6c286264493f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:08.351048 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54a62ae9-b5b4-4c9f-8c23-6c286264493f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:08.351806 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54a62ae9-b5b4-4c9f-8c23-6c286264493f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:08.352274 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54a62ae9-b5b4-4c9f-8c23-6c286264493f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:08.481392 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-54a62ae9-b5b4-4c9f-8c23-6c286264493f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:08.488980 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-54a62ae9-b5b4-4c9f-8c23-6c286264493f tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.150289 Aug 10 03:43:08.489549 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 408/803] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:08 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:09.032295 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d729011d-5cec-4010-8ec5-5176521579a8 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:09.032811 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d729011d-5cec-4010-8ec5-5176521579a8 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:09.038636 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d729011d-5cec-4010-8ec5-5176521579a8 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:09.039077 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d729011d-5cec-4010-8ec5-5176521579a8 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:09.039837 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d729011d-5cec-4010-8ec5-5176521579a8 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:09.040297 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d729011d-5cec-4010-8ec5-5176521579a8 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:09.159011 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d729011d-5cec-4010-8ec5-5176521579a8 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:09.166198 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d729011d-5cec-4010-8ec5-5176521579a8 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.137928 Aug 10 03:43:09.166756 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 396/804] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:09 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:09.505492 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-45a32eb1-e56b-4e08-b2a8-2bb1ac5ff33e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:09.506102 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-45a32eb1-e56b-4e08-b2a8-2bb1ac5ff33e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:09.511832 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-45a32eb1-e56b-4e08-b2a8-2bb1ac5ff33e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:09.512317 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-45a32eb1-e56b-4e08-b2a8-2bb1ac5ff33e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:09.513658 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-45a32eb1-e56b-4e08-b2a8-2bb1ac5ff33e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:09.514121 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-45a32eb1-e56b-4e08-b2a8-2bb1ac5ff33e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:09.640368 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-45a32eb1-e56b-4e08-b2a8-2bb1ac5ff33e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:09.647669 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-45a32eb1-e56b-4e08-b2a8-2bb1ac5ff33e tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.145783 Aug 10 03:43:09.648310 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 409/805] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:09 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:10.182753 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-96181350-67e6-4c1a-a4d5-3fdbf918761a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:10.183372 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-96181350-67e6-4c1a-a4d5-3fdbf918761a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:10.189690 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-96181350-67e6-4c1a-a4d5-3fdbf918761a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:10.190134 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-96181350-67e6-4c1a-a4d5-3fdbf918761a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:10.190902 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-96181350-67e6-4c1a-a4d5-3fdbf918761a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:10.191374 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-96181350-67e6-4c1a-a4d5-3fdbf918761a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:10.312087 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-96181350-67e6-4c1a-a4d5-3fdbf918761a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:10.319494 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-96181350-67e6-4c1a-a4d5-3fdbf918761a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.140358 Aug 10 03:43:10.320070 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 397/806] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:10 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:10.638763 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-15b30fca-49bb-4847-8955-5a841b075780 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] Calling method '.version_select at 0x7f97a15e4550>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:10.663291 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ba09a796-77d5-45f1-a4ad-0add9701cab4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:10.663900 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ba09a796-77d5-45f1-a4ad-0add9701cab4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:10.669683 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ba09a796-77d5-45f1-a4ad-0add9701cab4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:10.670133 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ba09a796-77d5-45f1-a4ad-0add9701cab4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:10.670934 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ba09a796-77d5-45f1-a4ad-0add9701cab4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:10.671362 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ba09a796-77d5-45f1-a4ad-0add9701cab4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:10.691267 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-15b30fca-49bb-4847-8955-5a841b075780 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/5e7148c3-6265-41dd-965d-0e4ca39a404e" status: 200 len: 351 microversion: 2.1 time: 0.056972 Aug 10 03:43:10.691867 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 410/807] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:43:10 2021] GET /compute/v2.1/os-volumes/5e7148c3-6265-41dd-965d-0e4ca39a404e => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:43:10.806157 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ba09a796-77d5-45f1-a4ad-0add9701cab4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:10.911757 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ba09a796-77d5-45f1-a4ad-0add9701cab4 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.156613 Aug 10 03:43:10.911757 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 398/808] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:10 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:43:10.911964 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-06fea49d-1b9c-4ea7-85dd-83a6066e0bc7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:43:10.911964 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-06fea49d-1b9c-4ea7-85dd-83a6066e0bc7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:10.911964 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-06fea49d-1b9c-4ea7-85dd-83a6066e0bc7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:10.919577 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-06fea49d-1b9c-4ea7-85dd-83a6066e0bc7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Going to try to stop instance {{(pid=108439) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Aug 10 03:43:11.239282 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-06fea49d-1b9c-4ea7-85dd-83a6066e0bc7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 202 len: 0 microversion: 2.1 time: 0.355588 Aug 10 03:43:11.239985 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 411/809] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:43:10 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:43:11.249250 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-dda917dc-b363-4d08-9451-e67c7a715422 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:11.249863 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-dda917dc-b363-4d08-9451-e67c7a715422 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:11.256106 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dda917dc-b363-4d08-9451-e67c7a715422 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:11.256578 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dda917dc-b363-4d08-9451-e67c7a715422 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:11.257350 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dda917dc-b363-4d08-9451-e67c7a715422 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:11.257777 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dda917dc-b363-4d08-9451-e67c7a715422 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:11.337012 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-140fbc97-57ab-4cbd-8cfa-bb9111b9b7b0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:11.337743 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-140fbc97-57ab-4cbd-8cfa-bb9111b9b7b0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:11.343800 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-140fbc97-57ab-4cbd-8cfa-bb9111b9b7b0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:11.344372 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-140fbc97-57ab-4cbd-8cfa-bb9111b9b7b0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:11.345132 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-140fbc97-57ab-4cbd-8cfa-bb9111b9b7b0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:11.345557 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-140fbc97-57ab-4cbd-8cfa-bb9111b9b7b0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:11.395418 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-dda917dc-b363-4d08-9451-e67c7a715422 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:11.403086 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-dda917dc-b363-4d08-9451-e67c7a715422 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.158561 Aug 10 03:43:11.403652 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 399/810] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:11 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:11.490450 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-140fbc97-57ab-4cbd-8cfa-bb9111b9b7b0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:11.490678 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-140fbc97-57ab-4cbd-8cfa-bb9111b9b7b0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.157487 Aug 10 03:43:11.491214 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 412/811] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:11 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:11.888283 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e1cd0502-f3b6-4c06-9e33-037b0a290c41 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:11.888930 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e1cd0502-f3b6-4c06-9e33-037b0a290c41 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:11.894831 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e1cd0502-f3b6-4c06-9e33-037b0a290c41 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:11.895308 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e1cd0502-f3b6-4c06-9e33-037b0a290c41 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:11.896135 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e1cd0502-f3b6-4c06-9e33-037b0a290c41 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:11.896695 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e1cd0502-f3b6-4c06-9e33-037b0a290c41 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:12.015336 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e1cd0502-f3b6-4c06-9e33-037b0a290c41 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:12.022508 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e1cd0502-f3b6-4c06-9e33-037b0a290c41 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.138480 Aug 10 03:43:12.023059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 400/812] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:11 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:12.420666 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-35135fb3-aeeb-4fa3-9485-9686024aeeb8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:12.421269 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-35135fb3-aeeb-4fa3-9485-9686024aeeb8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:12.427026 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-35135fb3-aeeb-4fa3-9485-9686024aeeb8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:12.427466 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-35135fb3-aeeb-4fa3-9485-9686024aeeb8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:12.428242 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-35135fb3-aeeb-4fa3-9485-9686024aeeb8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:12.428666 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-35135fb3-aeeb-4fa3-9485-9686024aeeb8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:12.508903 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3869bb72-f58f-4204-b52e-ff767e1014f9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:12.509516 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3869bb72-f58f-4204-b52e-ff767e1014f9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:12.515243 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3869bb72-f58f-4204-b52e-ff767e1014f9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:12.515689 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3869bb72-f58f-4204-b52e-ff767e1014f9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:12.516496 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3869bb72-f58f-4204-b52e-ff767e1014f9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:12.517104 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3869bb72-f58f-4204-b52e-ff767e1014f9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:12.554951 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-35135fb3-aeeb-4fa3-9485-9686024aeeb8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:12.562397 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-35135fb3-aeeb-4fa3-9485-9686024aeeb8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.146024 Aug 10 03:43:12.563477 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 413/813] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:12 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:12.637447 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3869bb72-f58f-4204-b52e-ff767e1014f9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:12.645515 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3869bb72-f58f-4204-b52e-ff767e1014f9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.140238 Aug 10 03:43:12.646065 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 401/814] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:12 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:43:13.038885 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5c3d2de0-aa05-4853-8553-fe7fb913a07d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:13.039493 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-5c3d2de0-aa05-4853-8553-fe7fb913a07d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:13.045439 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5c3d2de0-aa05-4853-8553-fe7fb913a07d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:13.045881 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5c3d2de0-aa05-4853-8553-fe7fb913a07d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:13.046635 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5c3d2de0-aa05-4853-8553-fe7fb913a07d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:13.047065 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5c3d2de0-aa05-4853-8553-fe7fb913a07d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:13.172321 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-5c3d2de0-aa05-4853-8553-fe7fb913a07d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:13.179629 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5c3d2de0-aa05-4853-8553-fe7fb913a07d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.144414 Aug 10 03:43:13.180354 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 414/815] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:13 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:13.579221 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d488c76e-7fff-472c-b7c5-4d007da35e3b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:13.579828 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d488c76e-7fff-472c-b7c5-4d007da35e3b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:13.585743 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d488c76e-7fff-472c-b7c5-4d007da35e3b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:13.592872 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d488c76e-7fff-472c-b7c5-4d007da35e3b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:13.592872 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d488c76e-7fff-472c-b7c5-4d007da35e3b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:13.592872 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d488c76e-7fff-472c-b7c5-4d007da35e3b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:13.662797 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-10a2cd10-9299-4c26-9fc6-dd8b79abc146 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:13.663787 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-10a2cd10-9299-4c26-9fc6-dd8b79abc146 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:13.669925 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-10a2cd10-9299-4c26-9fc6-dd8b79abc146 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:13.670480 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-10a2cd10-9299-4c26-9fc6-dd8b79abc146 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:13.671267 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-10a2cd10-9299-4c26-9fc6-dd8b79abc146 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:13.671680 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-10a2cd10-9299-4c26-9fc6-dd8b79abc146 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:13.710573 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d488c76e-7fff-472c-b7c5-4d007da35e3b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:13.718194 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d488c76e-7fff-472c-b7c5-4d007da35e3b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.142518 Aug 10 03:43:13.718761 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 402/816] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:13 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:13.802272 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-10a2cd10-9299-4c26-9fc6-dd8b79abc146 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:13.810716 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-10a2cd10-9299-4c26-9fc6-dd8b79abc146 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.151882 Aug 10 03:43:13.811280 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 415/817] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:13 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:43:14.196857 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-9d610cb5-c64c-4e51-a63a-3847a40d5da3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:14.197457 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-9d610cb5-c64c-4e51-a63a-3847a40d5da3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:14.203181 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9d610cb5-c64c-4e51-a63a-3847a40d5da3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:14.203622 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9d610cb5-c64c-4e51-a63a-3847a40d5da3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:14.204409 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9d610cb5-c64c-4e51-a63a-3847a40d5da3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:14.204840 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9d610cb5-c64c-4e51-a63a-3847a40d5da3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:14.325326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9d610cb5-c64c-4e51-a63a-3847a40d5da3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:14.332557 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-9d610cb5-c64c-4e51-a63a-3847a40d5da3 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.139308 Aug 10 03:43:14.333159 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 403/818] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:14 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:14.734939 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a659d50b-e7e2-44c3-bfb1-8e239c054649 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:14.735546 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a659d50b-e7e2-44c3-bfb1-8e239c054649 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:14.741472 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a659d50b-e7e2-44c3-bfb1-8e239c054649 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:14.741918 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a659d50b-e7e2-44c3-bfb1-8e239c054649 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:14.742699 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a659d50b-e7e2-44c3-bfb1-8e239c054649 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:14.743129 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a659d50b-e7e2-44c3-bfb1-8e239c054649 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:14.828439 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-39348f75-85d7-4eb3-b8da-62a591a60405 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:14.829098 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-39348f75-85d7-4eb3-b8da-62a591a60405 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:14.835644 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-39348f75-85d7-4eb3-b8da-62a591a60405 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:14.839497 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-39348f75-85d7-4eb3-b8da-62a591a60405 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:14.839497 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-39348f75-85d7-4eb3-b8da-62a591a60405 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:14.839497 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-39348f75-85d7-4eb3-b8da-62a591a60405 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:14.864238 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a659d50b-e7e2-44c3-bfb1-8e239c054649 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:14.871683 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a659d50b-e7e2-44c3-bfb1-8e239c054649 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.140619 Aug 10 03:43:14.872811 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 416/819] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:14 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:14.960763 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-39348f75-85d7-4eb3-b8da-62a591a60405 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:14.968229 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-39348f75-85d7-4eb3-b8da-62a591a60405 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1258 microversion: 2.1 time: 0.144109 Aug 10 03:43:14.968769 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 404/820] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:14 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1258 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:15.352772 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-48a9498a-7117-4916-8463-973f7f324428 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:15.353380 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-48a9498a-7117-4916-8463-973f7f324428 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:15.359646 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-48a9498a-7117-4916-8463-973f7f324428 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:15.360120 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-48a9498a-7117-4916-8463-973f7f324428 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:15.360979 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-48a9498a-7117-4916-8463-973f7f324428 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:15.361403 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-48a9498a-7117-4916-8463-973f7f324428 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:15.484976 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-48a9498a-7117-4916-8463-973f7f324428 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:15.492325 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-48a9498a-7117-4916-8463-973f7f324428 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.147523 Aug 10 03:43:15.492891 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 417/821] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:15 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:15.682502 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e654bc38-bb02-420f-8cd6-210aee4ad260 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] Calling method '.version_select at 0x7f97a01e3820>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:15.739306 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e654bc38-bb02-420f-8cd6-210aee4ad260 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/5afc5b78-696d-4eed-ac38-19db99f8b510" status: 200 len: 351 microversion: 2.1 time: 0.060882 Aug 10 03:43:15.740693 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 405/822] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:43:15 2021] GET /compute/v2.1/os-volumes/5afc5b78-696d-4eed-ac38-19db99f8b510 => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:43:15.890200 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-75c43533-b403-4475-a8da-53a193f954f6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:15.891462 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-75c43533-b403-4475-a8da-53a193f954f6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:15.897515 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-75c43533-b403-4475-a8da-53a193f954f6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:15.897956 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-75c43533-b403-4475-a8da-53a193f954f6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:15.903752 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-75c43533-b403-4475-a8da-53a193f954f6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:15.903752 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-75c43533-b403-4475-a8da-53a193f954f6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:15.985564 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6f090d66-1b0b-4042-8c11-80e884e8961f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:15.985946 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6f090d66-1b0b-4042-8c11-80e884e8961f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:15.993266 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6f090d66-1b0b-4042-8c11-80e884e8961f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:15.993920 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6f090d66-1b0b-4042-8c11-80e884e8961f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:15.994766 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6f090d66-1b0b-4042-8c11-80e884e8961f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:15.995341 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6f090d66-1b0b-4042-8c11-80e884e8961f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:16.039387 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-75c43533-b403-4475-a8da-53a193f954f6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:16.048881 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-75c43533-b403-4475-a8da-53a193f954f6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.163041 Aug 10 03:43:16.054300 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 418/823] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:15 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:16.149477 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6f090d66-1b0b-4042-8c11-80e884e8961f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:16.157277 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6f090d66-1b0b-4042-8c11-80e884e8961f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1442 microversion: 2.1 time: 0.177102 Aug 10 03:43:16.157913 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 406/824] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:15 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1442 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:43:16.172988 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-18f32ed9-fb06-4afc-a3c4-eaa6322611cf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:16.175960 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-18f32ed9-fb06-4afc-a3c4-eaa6322611cf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:16.182381 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-18f32ed9-fb06-4afc-a3c4-eaa6322611cf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:16.182934 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-18f32ed9-fb06-4afc-a3c4-eaa6322611cf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:16.183694 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-18f32ed9-fb06-4afc-a3c4-eaa6322611cf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:16.184113 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-18f32ed9-fb06-4afc-a3c4-eaa6322611cf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:16.321643 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-18f32ed9-fb06-4afc-a3c4-eaa6322611cf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:16.326132 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-18f32ed9-fb06-4afc-a3c4-eaa6322611cf tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1442 microversion: 2.1 time: 0.155890 Aug 10 03:43:16.326829 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 419/825] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:16 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:16.509444 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f3ac13b5-ccce-4f23-bbfc-4ca62668871c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:16.510143 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f3ac13b5-ccce-4f23-bbfc-4ca62668871c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:16.516333 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f3ac13b5-ccce-4f23-bbfc-4ca62668871c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:16.516825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f3ac13b5-ccce-4f23-bbfc-4ca62668871c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:16.517593 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f3ac13b5-ccce-4f23-bbfc-4ca62668871c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:16.518032 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f3ac13b5-ccce-4f23-bbfc-4ca62668871c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:16.644332 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f3ac13b5-ccce-4f23-bbfc-4ca62668871c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:16.651854 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f3ac13b5-ccce-4f23-bbfc-4ca62668871c tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.146141 Aug 10 03:43:16.652510 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 407/826] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:16 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:17.066469 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6175632a-0c8a-4624-9791-c0b4fce20028 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:17.067001 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6175632a-0c8a-4624-9791-c0b4fce20028 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:17.073073 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6175632a-0c8a-4624-9791-c0b4fce20028 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:17.073513 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6175632a-0c8a-4624-9791-c0b4fce20028 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:17.074288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6175632a-0c8a-4624-9791-c0b4fce20028 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:17.074719 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6175632a-0c8a-4624-9791-c0b4fce20028 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:17.204864 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6175632a-0c8a-4624-9791-c0b4fce20028 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:17.212762 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6175632a-0c8a-4624-9791-c0b4fce20028 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.149989 Aug 10 03:43:17.213418 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 420/827] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:17 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:17.668622 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6fbb624c-e080-40a8-bcb6-18ef70968912 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:17.669242 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6fbb624c-e080-40a8-bcb6-18ef70968912 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:17.675318 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6fbb624c-e080-40a8-bcb6-18ef70968912 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:17.675756 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6fbb624c-e080-40a8-bcb6-18ef70968912 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:17.676558 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6fbb624c-e080-40a8-bcb6-18ef70968912 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:17.677017 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6fbb624c-e080-40a8-bcb6-18ef70968912 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:17.997187 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6fbb624c-e080-40a8-bcb6-18ef70968912 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:18.005122 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6fbb624c-e080-40a8-bcb6-18ef70968912 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.340192 Aug 10 03:43:18.005762 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 408/828] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:17 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:18.230182 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-980aa79f-1c1b-4fbe-b003-0120cbf930a5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:18.230889 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-980aa79f-1c1b-4fbe-b003-0120cbf930a5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:18.237324 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-980aa79f-1c1b-4fbe-b003-0120cbf930a5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:18.237766 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-980aa79f-1c1b-4fbe-b003-0120cbf930a5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:18.238535 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-980aa79f-1c1b-4fbe-b003-0120cbf930a5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:18.238964 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-980aa79f-1c1b-4fbe-b003-0120cbf930a5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:18.362523 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-980aa79f-1c1b-4fbe-b003-0120cbf930a5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:18.369921 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-980aa79f-1c1b-4fbe-b003-0120cbf930a5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.143514 Aug 10 03:43:18.377189 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 421/829] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:18 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:18.559007 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-11616532-feef-42e9-a6d3-6b46dfb65e8e tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] Calling method '.version_select at 0x7f97a01cdf70>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:18.614181 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-11616532-feef-42e9-a6d3-6b46dfb65e8e tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/20d11976-ce99-45fc-b6f7-aeac241e4ee4" status: 200 len: 351 microversion: 2.1 time: 0.058676 Aug 10 03:43:18.614750 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 409/830] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:43:18 2021] GET /compute/v2.1/os-volumes/20d11976-ce99-45fc-b6f7-aeac241e4ee4 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:43:18.625776 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-55eab09b-0ac6-4761-a2be-83acdc87cd81 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] Calling method '.version_select at 0x7f97a0c45ca0>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:18.708878 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-55eab09b-0ac6-4761-a2be-83acdc87cd81 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] 10.222.0.21 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.086680 Aug 10 03:43:18.709440 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 422/831] 10.222.0.21 () {58 vars in 1134 bytes} [Tue Aug 10 03:43:18 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:18.721199 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-143e5534-5c82-46fe-8aa3-c8a43dadc285 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] Calling method '.version_select at 0x7f97a04635e0>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:18.804008 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-143e5534-5c82-46fe-8aa3-c8a43dadc285 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] 10.222.0.21 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086337 Aug 10 03:43:18.804764 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 410/832] 10.222.0.21 () {58 vars in 1149 bytes} [Tue Aug 10 03:43:18 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:43:18.815782 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-17d4481b-1a8b-400f-95ef-9056403e52d9 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] Calling method '.version_select at 0x7f97a0131ee0>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:18.900114 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-17d4481b-1a8b-400f-95ef-9056403e52d9 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] 10.222.0.21 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.087684 Aug 10 03:43:18.900713 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 423/833] 10.222.0.21 () {58 vars in 1134 bytes} [Tue Aug 10 03:43:18 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:18.912769 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7af071da-bf85-4166-b5c9-3833df3c6e44 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] Calling method '.version_select at 0x7f97a0142ca0>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:19.019465 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7af071da-bf85-4166-b5c9-3833df3c6e44 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] 10.222.0.21 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.110552 Aug 10 03:43:19.020638 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 411/834] 10.222.0.21 () {58 vars in 1167 bytes} [Tue Aug 10 03:43:18 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:43:19.026546 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-346b1445-571d-4e71-a1a5-2b373dd7e97d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:19.026546 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-346b1445-571d-4e71-a1a5-2b373dd7e97d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:19.032213 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3b4665dd-2b26-439c-91c8-8b8c04f1c30d tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] Calling method '.version_select at 0x7f97a015fee0>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:19.043285 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-346b1445-571d-4e71-a1a5-2b373dd7e97d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:19.043285 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-346b1445-571d-4e71-a1a5-2b373dd7e97d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:19.043285 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-346b1445-571d-4e71-a1a5-2b373dd7e97d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:19.043285 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-346b1445-571d-4e71-a1a5-2b373dd7e97d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:19.125722 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3b4665dd-2b26-439c-91c8-8b8c04f1c30d tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.097555 Aug 10 03:43:19.127128 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 412/835] 10.222.0.21 () {58 vars in 1170 bytes} [Tue Aug 10 03:43:19 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:43:19.146192 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-d4a9c4f0-4782-4c90-8ce0-38b6950e8c00 req-8ce57558-16f2-41ac-af0f-2aa27140bbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a89090-7d79-496b-878d-213d6f48b970", "tag": "6f883b5b-35b9-44d5-8f3d-ba0bf7b04925"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:43:19.149072 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:43:19.149072 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:43:19.157349 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-d4a9c4f0-4782-4c90-8ce0-38b6950e8c00 req-8ce57558-16f2-41ac-af0f-2aa27140bbd4 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:19.158106 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-d4a9c4f0-4782-4c90-8ce0-38b6950e8c00 req-8ce57558-16f2-41ac-af0f-2aa27140bbd4 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:19.171866 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-d4a9c4f0-4782-4c90-8ce0-38b6950e8c00 req-8ce57558-16f2-41ac-af0f-2aa27140bbd4 service nova] Creating event network-changed:6f883b5b-35b9-44d5-8f3d-ba0bf7b04925 for instance 43a89090-7d79-496b-878d-213d6f48b970 on hv-cinder-78239 Aug 10 03:43:19.177650 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-d4a9c4f0-4782-4c90-8ce0-38b6950e8c00 req-8ce57558-16f2-41ac-af0f-2aa27140bbd4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035381 Aug 10 03:43:19.179755 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 413/836] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:43:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:43:19.183631 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6cd5d12d-baaf-4bbb-a25f-58b9b7163672 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] Calling method '.version_select at 0x7f97a0463040>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:19.189652 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-346b1445-571d-4e71-a1a5-2b373dd7e97d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:19.198841 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-346b1445-571d-4e71-a1a5-2b373dd7e97d tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.179640 Aug 10 03:43:19.199506 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 424/837] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:19 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:43:19.266997 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6cd5d12d-baaf-4bbb-a25f-58b9b7163672 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.087390 Aug 10 03:43:19.267606 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 414/838] 10.222.0.21 () {58 vars in 1155 bytes} [Tue Aug 10 03:43:19 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:19.282867 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3d8c4756-6ee1-4132-be7b-78c5a5e2e652 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] Calling method '.version_select at 0x7f97a1f27040>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:19.367045 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3d8c4756-6ee1-4132-be7b-78c5a5e2e652 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091182 Aug 10 03:43:19.367622 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 425/839] 10.222.0.21 () {58 vars in 1188 bytes} [Tue Aug 10 03:43:19 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:43:19.383113 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a017aec5-688a-4df7-9678-e3b2327faf85 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] Calling method '.version_select at 0x7f97a0142940>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:19.389392 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ea1e47ac-9933-404c-8fc5-57c19b434dee tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:19.390118 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ea1e47ac-9933-404c-8fc5-57c19b434dee tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:19.398243 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ea1e47ac-9933-404c-8fc5-57c19b434dee tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:19.399278 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ea1e47ac-9933-404c-8fc5-57c19b434dee tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:19.400138 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ea1e47ac-9933-404c-8fc5-57c19b434dee tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:19.400671 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ea1e47ac-9933-404c-8fc5-57c19b434dee tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:19.477321 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a017aec5-688a-4df7-9678-e3b2327faf85 tempest-VolumesTestJSON-1883182485 tempest-VolumesTestJSON-1883182485-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.099487 Aug 10 03:43:19.477883 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 415/840] 10.222.0.21 () {58 vars in 1155 bytes} [Tue Aug 10 03:43:19 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:19.557124 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ea1e47ac-9933-404c-8fc5-57c19b434dee tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:19.565436 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ea1e47ac-9933-404c-8fc5-57c19b434dee tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.182358 Aug 10 03:43:19.566176 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 426/841] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:19 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:43:20.216761 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d71c16a6-37c3-491b-9ea9-b38262cf0b36 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:20.217489 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d71c16a6-37c3-491b-9ea9-b38262cf0b36 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:20.224568 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d71c16a6-37c3-491b-9ea9-b38262cf0b36 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:20.225063 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d71c16a6-37c3-491b-9ea9-b38262cf0b36 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:20.225832 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d71c16a6-37c3-491b-9ea9-b38262cf0b36 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:20.226261 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d71c16a6-37c3-491b-9ea9-b38262cf0b36 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:20.356541 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d71c16a6-37c3-491b-9ea9-b38262cf0b36 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:20.364461 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d71c16a6-37c3-491b-9ea9-b38262cf0b36 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1522 microversion: 2.1 time: 0.151870 Aug 10 03:43:20.364964 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 416/842] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:20 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:20.583199 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ce1d770a-066e-46dd-a2f0-7b74eb4a02f3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:20.583816 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ce1d770a-066e-46dd-a2f0-7b74eb4a02f3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:20.589693 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce1d770a-066e-46dd-a2f0-7b74eb4a02f3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:20.590143 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce1d770a-066e-46dd-a2f0-7b74eb4a02f3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:20.590965 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce1d770a-066e-46dd-a2f0-7b74eb4a02f3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:20.591398 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce1d770a-066e-46dd-a2f0-7b74eb4a02f3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:20.722647 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ce1d770a-066e-46dd-a2f0-7b74eb4a02f3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:20.731828 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ce1d770a-066e-46dd-a2f0-7b74eb4a02f3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.151655 Aug 10 03:43:20.732408 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 427/843] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:20 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:43:21.192985 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-da4ce003-b34f-4e63-9137-c04549250879 req-9c026479-aebc-466c-856e-83063cf435c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c37d94-d078-4e35-819d-2ca11fc5cb5f", "name": "network-vif-deleted", "tag": "88abaf7a-ebcd-437f-9081-731c60519ffb"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:43:21.194534 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:43:21.194534 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:43:21.201210 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-da4ce003-b34f-4e63-9137-c04549250879 req-9c026479-aebc-466c-856e-83063cf435c1 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:21.201640 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-da4ce003-b34f-4e63-9137-c04549250879 req-9c026479-aebc-466c-856e-83063cf435c1 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:21.212888 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-da4ce003-b34f-4e63-9137-c04549250879 req-9c026479-aebc-466c-856e-83063cf435c1 service nova] Creating event network-vif-deleted:88abaf7a-ebcd-437f-9081-731c60519ffb for instance f2c37d94-d078-4e35-819d-2ca11fc5cb5f on hv-cinder-78239 Aug 10 03:43:21.217811 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-da4ce003-b34f-4e63-9137-c04549250879 req-9c026479-aebc-466c-856e-83063cf435c1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028724 Aug 10 03:43:21.218555 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 417/844] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:43:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:43:21.380774 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-85324d10-4d3e-438f-a04c-bc351bfe1572 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:21.381379 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-85324d10-4d3e-438f-a04c-bc351bfe1572 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:21.387246 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-85324d10-4d3e-438f-a04c-bc351bfe1572 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:21.387692 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-85324d10-4d3e-438f-a04c-bc351bfe1572 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:21.388528 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-85324d10-4d3e-438f-a04c-bc351bfe1572 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:21.388963 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-85324d10-4d3e-438f-a04c-bc351bfe1572 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:21.450382 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-85324d10-4d3e-438f-a04c-bc351bfe1572 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6c08307964f198aa7efc7961aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa352203a74307bd3b6157f78f6b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:21.457535 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-85324d10-4d3e-438f-a04c-bc351bfe1572 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 200 len: 1307 microversion: 2.1 time: 0.080388 Aug 10 03:43:21.458096 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 428/845] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:21 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 1307 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:21.750826 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7dc374c0-424a-4cc0-8451-863414ef0c6e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:21.751326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7dc374c0-424a-4cc0-8451-863414ef0c6e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:21.757869 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7dc374c0-424a-4cc0-8451-863414ef0c6e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:21.758316 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7dc374c0-424a-4cc0-8451-863414ef0c6e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:21.759096 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7dc374c0-424a-4cc0-8451-863414ef0c6e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:21.759532 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7dc374c0-424a-4cc0-8451-863414ef0c6e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:21.972272 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7dc374c0-424a-4cc0-8451-863414ef0c6e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:21.979640 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7dc374c0-424a-4cc0-8451-863414ef0c6e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.233858 Aug 10 03:43:21.980210 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 418/846] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:21 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:22.475052 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6810ce5b-d9aa-45bf-a1c2-d2480c7520c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:22.476373 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6810ce5b-d9aa-45bf-a1c2-d2480c7520c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] [instance: f2c37d94-d078-4e35-819d-2ca11fc5cb5f] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:22.483356 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6810ce5b-d9aa-45bf-a1c2-d2480c7520c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:22.484046 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6810ce5b-d9aa-45bf-a1c2-d2480c7520c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:22.485422 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6810ce5b-d9aa-45bf-a1c2-d2480c7520c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:22.485897 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6810ce5b-d9aa-45bf-a1c2-d2480c7520c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:22.500374 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-6810ce5b-d9aa-45bf-a1c2-d2480c7520c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] HTTP exception thrown: Instance f2c37d94-d078-4e35-819d-2ca11fc5cb5f could not be found. Aug 10 03:43:22.500983 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6810ce5b-d9aa-45bf-a1c2-d2480c7520c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] Returning 404 to user: Instance f2c37d94-d078-4e35-819d-2ca11fc5cb5f could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:43:22.501813 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6810ce5b-d9aa-45bf-a1c2-d2480c7520c2 tempest-ServerRescueNegativeTestJSON-1106789139 tempest-ServerRescueNegativeTestJSON-1106789139-project] 10.222.0.21 "GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f" status: 404 len: 111 microversion: 2.1 time: 0.030672 Aug 10 03:43:22.502375 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 429/847] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:22 2021] GET /compute/v2.1/servers/f2c37d94-d078-4e35-819d-2ca11fc5cb5f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:43:22.998530 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1137e057-ef67-44d1-8b22-44da399e8259 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:22.999250 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1137e057-ef67-44d1-8b22-44da399e8259 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:23.015812 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1137e057-ef67-44d1-8b22-44da399e8259 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:23.016275 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1137e057-ef67-44d1-8b22-44da399e8259 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:23.019243 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1137e057-ef67-44d1-8b22-44da399e8259 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:23.019243 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1137e057-ef67-44d1-8b22-44da399e8259 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:23.168061 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1137e057-ef67-44d1-8b22-44da399e8259 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:23.185867 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1137e057-ef67-44d1-8b22-44da399e8259 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.187886 Aug 10 03:43:23.186739 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 419/848] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:22 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:24.203368 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-093d0be3-8a05-457f-9b62-6c6a300f0229 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:24.205029 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-093d0be3-8a05-457f-9b62-6c6a300f0229 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:24.211106 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-093d0be3-8a05-457f-9b62-6c6a300f0229 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:24.211548 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-093d0be3-8a05-457f-9b62-6c6a300f0229 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:24.212382 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-093d0be3-8a05-457f-9b62-6c6a300f0229 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:24.212809 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-093d0be3-8a05-457f-9b62-6c6a300f0229 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:24.431738 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-093d0be3-8a05-457f-9b62-6c6a300f0229 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:24.439386 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-093d0be3-8a05-457f-9b62-6c6a300f0229 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.240370 Aug 10 03:43:24.462479 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 430/849] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:24 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:25.457001 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-acec942b-5bb7-4405-859d-f09f6d119c77 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:25.458524 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-acec942b-5bb7-4405-859d-f09f6d119c77 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:25.466075 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-acec942b-5bb7-4405-859d-f09f6d119c77 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:25.466751 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-acec942b-5bb7-4405-859d-f09f6d119c77 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:25.467767 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-acec942b-5bb7-4405-859d-f09f6d119c77 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:25.468834 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-acec942b-5bb7-4405-859d-f09f6d119c77 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:25.660701 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-acec942b-5bb7-4405-859d-f09f6d119c77 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:25.671278 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-acec942b-5bb7-4405-859d-f09f6d119c77 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.215897 Aug 10 03:43:25.679609 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 420/850] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:25 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:26.690564 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-42417031-04f3-449d-ba9a-ce62be1af387 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:26.691509 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-42417031-04f3-449d-ba9a-ce62be1af387 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:26.701769 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-42417031-04f3-449d-ba9a-ce62be1af387 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:26.702941 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-42417031-04f3-449d-ba9a-ce62be1af387 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:26.703912 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-42417031-04f3-449d-ba9a-ce62be1af387 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:26.705208 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-42417031-04f3-449d-ba9a-ce62be1af387 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:26.962526 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-42417031-04f3-449d-ba9a-ce62be1af387 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:26.980053 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-42417031-04f3-449d-ba9a-ce62be1af387 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.285541 Aug 10 03:43:26.980053 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 431/851] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:26 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:27.988983 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-cc5906c9-3eb6-4c35-b682-5339e7cc749d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:27.990134 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-cc5906c9-3eb6-4c35-b682-5339e7cc749d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:27.996735 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cc5906c9-3eb6-4c35-b682-5339e7cc749d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:27.998444 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cc5906c9-3eb6-4c35-b682-5339e7cc749d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:27.999780 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cc5906c9-3eb6-4c35-b682-5339e7cc749d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:28.000673 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cc5906c9-3eb6-4c35-b682-5339e7cc749d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:28.157696 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-cc5906c9-3eb6-4c35-b682-5339e7cc749d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:28.166318 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-cc5906c9-3eb6-4c35-b682-5339e7cc749d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.180950 Aug 10 03:43:28.176919 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 421/852] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:27 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:29.183453 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-807e8b5c-9b99-4536-8bbe-91b235e04a8d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:29.184744 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-807e8b5c-9b99-4536-8bbe-91b235e04a8d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:29.191855 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-807e8b5c-9b99-4536-8bbe-91b235e04a8d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:29.192337 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-807e8b5c-9b99-4536-8bbe-91b235e04a8d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:29.193129 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-807e8b5c-9b99-4536-8bbe-91b235e04a8d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:29.193560 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-807e8b5c-9b99-4536-8bbe-91b235e04a8d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:29.388159 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-807e8b5c-9b99-4536-8bbe-91b235e04a8d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:29.412628 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-807e8b5c-9b99-4536-8bbe-91b235e04a8d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1678 microversion: 2.1 time: 0.232699 Aug 10 03:43:29.420347 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 432/853] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:29 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:30.437049 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1b086068-59c4-4501-ac14-2f341b93463f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:30.437762 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1b086068-59c4-4501-ac14-2f341b93463f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:30.444549 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1b086068-59c4-4501-ac14-2f341b93463f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:30.445160 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1b086068-59c4-4501-ac14-2f341b93463f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:30.446838 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1b086068-59c4-4501-ac14-2f341b93463f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:30.447422 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1b086068-59c4-4501-ac14-2f341b93463f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:30.641002 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1b086068-59c4-4501-ac14-2f341b93463f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:30.651205 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1b086068-59c4-4501-ac14-2f341b93463f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1655 microversion: 2.1 time: 0.218101 Aug 10 03:43:30.651761 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 422/854] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:30 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1655 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:43:30.671820 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ee1a93cb-f7ff-4a77-afcd-08a89a4b38dd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:43:30.681003 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ee1a93cb-f7ff-4a77-afcd-08a89a4b38dd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:30.681599 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ee1a93cb-f7ff-4a77-afcd-08a89a4b38dd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:30.721673 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ee1a93cb-f7ff-4a77-afcd-08a89a4b38dd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Going to try to start instance {{(pid=108439) start /opt/stack/nova/nova/compute/api.py:2603}} Aug 10 03:43:30.810467 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c95cae12-edc6-4a1c-a7b5-dbdfe6ee3191 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55c64b6b-c4f6-47c7-8052-599b613e8dfd", "device": "/dev/sdb"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:43:30.811414 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c95cae12-edc6-4a1c-a7b5-dbdfe6ee3191 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:30.819499 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c95cae12-edc6-4a1c-a7b5-dbdfe6ee3191 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:30.820137 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c95cae12-edc6-4a1c-a7b5-dbdfe6ee3191 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:30.820916 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c95cae12-edc6-4a1c-a7b5-dbdfe6ee3191 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:30.821489 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c95cae12-edc6-4a1c-a7b5-dbdfe6ee3191 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:30.951096 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ee1a93cb-f7ff-4a77-afcd-08a89a4b38dd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action" status: 202 len: 0 microversion: 2.1 time: 0.282286 Aug 10 03:43:30.955334 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 433/855] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:43:30 2021] POST /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:43:30.960653 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f69496d3-15d6-4d99-888f-d91bc82bcd64 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:30.961363 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f69496d3-15d6-4d99-888f-d91bc82bcd64 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:30.973714 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f69496d3-15d6-4d99-888f-d91bc82bcd64 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:30.975757 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f69496d3-15d6-4d99-888f-d91bc82bcd64 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:30.976630 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f69496d3-15d6-4d99-888f-d91bc82bcd64 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:30.977284 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f69496d3-15d6-4d99-888f-d91bc82bcd64 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:31.172991 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f69496d3-15d6-4d99-888f-d91bc82bcd64 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:31.182738 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f69496d3-15d6-4d99-888f-d91bc82bcd64 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1664 microversion: 2.1 time: 0.225883 Aug 10 03:43:31.183721 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 434/856] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:30 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1664 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:31.957853 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c95cae12-edc6-4a1c-a7b5-dbdfe6ee3191 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "POST /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.152715 Aug 10 03:43:31.959330 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 423/857] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 10 03:43:30 2021] POST /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118/os-volume_attachments => generated 194 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:43:32.202928 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b931dc88-ee80-474b-9bbe-c51aeee43f7d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:32.205326 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b931dc88-ee80-474b-9bbe-c51aeee43f7d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:32.214898 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b931dc88-ee80-474b-9bbe-c51aeee43f7d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:32.216393 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b931dc88-ee80-474b-9bbe-c51aeee43f7d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:32.217562 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b931dc88-ee80-474b-9bbe-c51aeee43f7d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:32.218286 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b931dc88-ee80-474b-9bbe-c51aeee43f7d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:32.398104 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b931dc88-ee80-474b-9bbe-c51aeee43f7d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:32.406143 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b931dc88-ee80-474b-9bbe-c51aeee43f7d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1664 microversion: 2.1 time: 0.208204 Aug 10 03:43:32.407075 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 435/858] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:32 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1664 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:33.423992 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-79345f95-a116-4c60-b689-1817532501b3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:33.424713 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-79345f95-a116-4c60-b689-1817532501b3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:33.431059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-79345f95-a116-4c60-b689-1817532501b3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:33.431497 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-79345f95-a116-4c60-b689-1817532501b3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:33.432280 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-79345f95-a116-4c60-b689-1817532501b3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:33.432704 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-79345f95-a116-4c60-b689-1817532501b3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:33.846076 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-79345f95-a116-4c60-b689-1817532501b3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:33.854148 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-79345f95-a116-4c60-b689-1817532501b3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1668 microversion: 2.1 time: 0.434087 Aug 10 03:43:33.854892 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 424/859] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:33 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1668 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:50.794029 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-124a0c76-5790-4066-84c0-0a73768aa495 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Action: 'create', calling method: .version_select at 0x7f97a00ccd30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1413623835"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:43:50.811095 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-124a0c76-5790-4066-84c0-0a73768aa495 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Getting quotas for project a2ebcc2259864e7b91ab0fe1190f0f2e. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:43:50.814896 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-124a0c76-5790-4066-84c0-0a73768aa495 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Getting quotas for user 79bc1be4a0e5421aa5e8c2792f7fb05a and project a2ebcc2259864e7b91ab0fe1190f0f2e. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:43:51.351236 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-124a0c76-5790-4066-84c0-0a73768aa495 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Getting quotas for project a2ebcc2259864e7b91ab0fe1190f0f2e. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:43:51.354841 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-124a0c76-5790-4066-84c0-0a73768aa495 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Getting quotas for user 79bc1be4a0e5421aa5e8c2792f7fb05a and project a2ebcc2259864e7b91ab0fe1190f0f2e. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:43:51.368613 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-124a0c76-5790-4066-84c0-0a73768aa495 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.578132 Aug 10 03:43:51.369242 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 436/860] 10.222.0.21 () {60 vars in 1158 bytes} [Tue Aug 10 03:43:50 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:51.465030 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-665462255", "imageRef": "4d8d55d6-5ef3-49cd-93f3-2a826b3674ff", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1413623835", "networks": [{"uuid": "57c80750-82ba-4320-ac73-b21c6cc1fc52"}]}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:43:51.514743 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.network.neutron [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] validate_networks() for [('57c80750-82ba-4320-ac73-b21c6cc1fc52', None, None, None)] {{(pid=108440) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:43:51.901754 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Flavor limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:43:51.902170 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Image limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:43:51.903156 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Flavor pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:43:51.903676 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Image pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:43:51.904153 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:43:51.912439 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:51.912897 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:51.913718 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:51.914142 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:51.930359 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Getting quotas for project a2ebcc2259864e7b91ab0fe1190f0f2e. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:43:51.934156 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Getting quotas for user 79bc1be4a0e5421aa5e8c2792f7fb05a and project a2ebcc2259864e7b91ab0fe1190f0f2e. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:43:51.945174 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Going to run 1 instances... {{(pid=108440) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:43:51.947427 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d8d55d6-5ef3-49cd-93f3-2a826b3674ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:43:52.191097 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8f8a6ac3-96e7-4f47-8a99-20746fce715c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729726 Aug 10 03:43:52.191876 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 425/861] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:43:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 03:43:52.201887 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8af9b72c-a6cd-47eb-80b4-3305ae59cdf0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:52.202899 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8af9b72c-a6cd-47eb-80b4-3305ae59cdf0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:52.254707 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8af9b72c-a6cd-47eb-80b4-3305ae59cdf0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:52.262528 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8af9b72c-a6cd-47eb-80b4-3305ae59cdf0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1258 microversion: 2.1 time: 0.064279 Aug 10 03:43:52.263113 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 437/862] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:52 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:43:53.278974 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8d062800-4f89-4bc6-9cca-8821d74d9392 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:53.279730 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8d062800-4f89-4bc6-9cca-8821d74d9392 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:53.343460 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-8d062800-4f89-4bc6-9cca-8821d74d9392 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:53.349881 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8d062800-4f89-4bc6-9cca-8821d74d9392 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1258 microversion: 2.1 time: 0.074655 Aug 10 03:43:53.350442 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 426/863] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:53 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:54.366830 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a5f421db-e481-42d6-8ac4-b19400673dab tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:54.367960 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a5f421db-e481-42d6-8ac4-b19400673dab tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:54.374517 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a5f421db-e481-42d6-8ac4-b19400673dab tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:54.374951 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a5f421db-e481-42d6-8ac4-b19400673dab tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:54.375732 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a5f421db-e481-42d6-8ac4-b19400673dab tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:54.376164 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a5f421db-e481-42d6-8ac4-b19400673dab tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:54.435994 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a5f421db-e481-42d6-8ac4-b19400673dab tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:54.444230 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a5f421db-e481-42d6-8ac4-b19400673dab tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1262 microversion: 2.1 time: 0.081181 Aug 10 03:43:54.444949 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 438/864] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:54 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:55.460328 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-365aacfa-65e1-42a5-9981-b751a582344b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:55.460979 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-365aacfa-65e1-42a5-9981-b751a582344b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:55.468000 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-365aacfa-65e1-42a5-9981-b751a582344b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:55.468491 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-365aacfa-65e1-42a5-9981-b751a582344b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:55.469278 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-365aacfa-65e1-42a5-9981-b751a582344b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:55.469707 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-365aacfa-65e1-42a5-9981-b751a582344b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:55.528848 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-365aacfa-65e1-42a5-9981-b751a582344b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:55.536008 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-365aacfa-65e1-42a5-9981-b751a582344b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1310 microversion: 2.1 time: 0.079416 Aug 10 03:43:55.536602 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 427/865] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:55 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1310 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:56.550612 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b741819f-04ee-419b-9c9f-d9493183c04f] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 03:43:56.553928 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e5f8b3c5-995c-4c33-b9e7-1c1e417050b7 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:56.554603 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e5f8b3c5-995c-4c33-b9e7-1c1e417050b7 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:56.560423 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5f8b3c5-995c-4c33-b9e7-1c1e417050b7 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:56.560856 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5f8b3c5-995c-4c33-b9e7-1c1e417050b7 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:56.561604 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5f8b3c5-995c-4c33-b9e7-1c1e417050b7 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:56.562027 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5f8b3c5-995c-4c33-b9e7-1c1e417050b7 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:56.636021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e5f8b3c5-995c-4c33-b9e7-1c1e417050b7 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:56.636021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e5f8b3c5-995c-4c33-b9e7-1c1e417050b7 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1328 microversion: 2.1 time: 0.081525 Aug 10 03:43:56.636021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 439/866] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:56 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1328 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:57.648394 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-43cc10bb-acca-4c38-ad2c-6018806968ed tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:57.649871 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-43cc10bb-acca-4c38-ad2c-6018806968ed tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:57.658581 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43cc10bb-acca-4c38-ad2c-6018806968ed tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:57.660591 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43cc10bb-acca-4c38-ad2c-6018806968ed tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:57.660591 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43cc10bb-acca-4c38-ad2c-6018806968ed tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:57.660591 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-43cc10bb-acca-4c38-ad2c-6018806968ed tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:58.014386 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-43cc10bb-acca-4c38-ad2c-6018806968ed tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:58.032090 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-43cc10bb-acca-4c38-ad2c-6018806968ed tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.388362 Aug 10 03:43:58.032784 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 428/867] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:57 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:58.823963 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-b5f51fa1-9650-46f2-8b21-0f523b3ca8d6 req-61b0810b-1c64-452d-a572-35dee35814ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2969b784-ae47-4dce-a4d1-f86c2d508de8", "tag": "e4c32421-6086-4a06-97cd-96e3d3edc391"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:43:58.838061 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:43:58.838061 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:43:58.870935 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-b5f51fa1-9650-46f2-8b21-0f523b3ca8d6 req-61b0810b-1c64-452d-a572-35dee35814ac service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:58.876836 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-b5f51fa1-9650-46f2-8b21-0f523b3ca8d6 req-61b0810b-1c64-452d-a572-35dee35814ac service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:58.906915 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-b5f51fa1-9650-46f2-8b21-0f523b3ca8d6 req-61b0810b-1c64-452d-a572-35dee35814ac service nova] Creating event network-changed:e4c32421-6086-4a06-97cd-96e3d3edc391 for instance 2969b784-ae47-4dce-a4d1-f86c2d508de8 on hv-cinder-78239 Aug 10 03:43:58.912934 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-b5f51fa1-9650-46f2-8b21-0f523b3ca8d6 req-61b0810b-1c64-452d-a572-35dee35814ac service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093185 Aug 10 03:43:58.913998 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 440/868] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:43:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:43:59.056557 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b5d4b240-8c7d-4b4a-8ea2-3350dd127f28 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:59.057185 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b5d4b240-8c7d-4b4a-8ea2-3350dd127f28 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:59.063247 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b5d4b240-8c7d-4b4a-8ea2-3350dd127f28 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:59.063693 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b5d4b240-8c7d-4b4a-8ea2-3350dd127f28 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:59.064740 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b5d4b240-8c7d-4b4a-8ea2-3350dd127f28 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:59.065090 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b5d4b240-8c7d-4b4a-8ea2-3350dd127f28 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:59.074537 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9603abb8-25c7-4aaa-99ca-42583948bca3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:43:59.078171 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9603abb8-25c7-4aaa-99ca-42583948bca3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:43:59.083818 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO oslo.messaging._drivers.impl_rabbit [-] [b741819f-04ee-419b-9c9f-d9493183c04f] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 44702. Aug 10 03:43:59.085924 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9603abb8-25c7-4aaa-99ca-42583948bca3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:59.086538 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9603abb8-25c7-4aaa-99ca-42583948bca3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:59.087561 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9603abb8-25c7-4aaa-99ca-42583948bca3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:43:59.088347 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9603abb8-25c7-4aaa-99ca-42583948bca3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:43:59.190038 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-9603abb8-25c7-4aaa-99ca-42583948bca3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lazy-loading 'services' on Instance uuid 1dc93e7b-20ee-49c2-8f30-c97c884a1118 {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:43:59.217211 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b5d4b240-8c7d-4b4a-8ea2-3350dd127f28 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:43:59.225743 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b5d4b240-8c7d-4b4a-8ea2-3350dd127f28 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.172866 Aug 10 03:43:59.226310 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 429/869] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:43:59 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:43:59.482360 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9603abb8-25c7-4aaa-99ca-42583948bca3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118/os-volume_attachments/55c64b6b-c4f6-47c7-8052-599b613e8dfd" status: 202 len: 0 microversion: 2.1 time: 0.413093 Aug 10 03:43:59.486500 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 441/870] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 10 03:43:59 2021] DELETE /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118/os-volume_attachments/55c64b6b-c4f6-47c7-8052-599b613e8dfd => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:44:00.244431 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b8057d93-1da2-42ce-8e11-c136d1a8a4fb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:00.249405 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b8057d93-1da2-42ce-8e11-c136d1a8a4fb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:00.255990 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b8057d93-1da2-42ce-8e11-c136d1a8a4fb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:00.256745 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b8057d93-1da2-42ce-8e11-c136d1a8a4fb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:00.257811 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b8057d93-1da2-42ce-8e11-c136d1a8a4fb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:00.258408 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b8057d93-1da2-42ce-8e11-c136d1a8a4fb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:00.391356 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b8057d93-1da2-42ce-8e11-c136d1a8a4fb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:00.400584 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b8057d93-1da2-42ce-8e11-c136d1a8a4fb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.160696 Aug 10 03:44:00.401932 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 430/871] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:00 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:01.422630 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-59daed48-ff45-425e-b354-f707771e8738 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:01.423808 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-59daed48-ff45-425e-b354-f707771e8738 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:01.431742 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-59daed48-ff45-425e-b354-f707771e8738 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:01.442606 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-59daed48-ff45-425e-b354-f707771e8738 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:01.444043 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-59daed48-ff45-425e-b354-f707771e8738 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:01.444704 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-59daed48-ff45-425e-b354-f707771e8738 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:01.599817 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-59daed48-ff45-425e-b354-f707771e8738 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:01.608046 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-59daed48-ff45-425e-b354-f707771e8738 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.190660 Aug 10 03:44:01.610820 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 442/872] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:01 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:02.625240 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c2d1fe1d-c214-443d-8dca-c8d765e4cfaa tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:02.625846 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c2d1fe1d-c214-443d-8dca-c8d765e4cfaa tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:02.632722 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c2d1fe1d-c214-443d-8dca-c8d765e4cfaa tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:02.633187 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c2d1fe1d-c214-443d-8dca-c8d765e4cfaa tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:02.634069 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c2d1fe1d-c214-443d-8dca-c8d765e4cfaa tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:02.634523 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c2d1fe1d-c214-443d-8dca-c8d765e4cfaa tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:02.745115 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1af52ae0-fd9f-4a88-b85c-b0937bc37c50 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:02.751854 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1af52ae0-fd9f-4a88-b85c-b0937bc37c50 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:02.760068 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1af52ae0-fd9f-4a88-b85c-b0937bc37c50 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:02.764656 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1af52ae0-fd9f-4a88-b85c-b0937bc37c50 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:02.764656 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1af52ae0-fd9f-4a88-b85c-b0937bc37c50 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:02.764656 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1af52ae0-fd9f-4a88-b85c-b0937bc37c50 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:02.783680 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c2d1fe1d-c214-443d-8dca-c8d765e4cfaa tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:02.792174 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c2d1fe1d-c214-443d-8dca-c8d765e4cfaa tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.170773 Aug 10 03:44:02.793762 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 431/873] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:02 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:02.799273 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1af52ae0-fd9f-4a88-b85c-b0937bc37c50 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments/944704e4-426c-4ad8-813f-591ae4b2e0a4" status: 200 len: 194 microversion: 2.20 time: 0.058659 Aug 10 03:44:02.800393 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 443/874] 10.222.0.21 () {60 vars in 1454 bytes} [Tue Aug 10 03:44:02 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments/944704e4-426c-4ad8-813f-591ae4b2e0a4 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:44:02.870360 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d64a6143-3e31-4382-8299-9588254f5d91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:02.870873 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d64a6143-3e31-4382-8299-9588254f5d91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:02.876531 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d64a6143-3e31-4382-8299-9588254f5d91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:02.879871 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d64a6143-3e31-4382-8299-9588254f5d91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:02.879871 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d64a6143-3e31-4382-8299-9588254f5d91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:02.879871 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d64a6143-3e31-4382-8299-9588254f5d91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:02.969365 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-d64a6143-3e31-4382-8299-9588254f5d91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lazy-loading 'services' on Instance uuid 0c599984-f271-4886-be2f-73e7531f52e4 {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:44:03.232509 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d64a6143-3e31-4382-8299-9588254f5d91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "DELETE /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments/944704e4-426c-4ad8-813f-591ae4b2e0a4" status: 202 len: 0 microversion: 2.20 time: 0.365641 Aug 10 03:44:03.233104 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 432/875] 10.222.0.21 () {60 vars in 1457 bytes} [Tue Aug 10 03:44:02 2021] DELETE /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments/944704e4-426c-4ad8-813f-591ae4b2e0a4 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:44:03.241429 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-49db3b1b-e563-4029-9d51-5577bb8170b6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:03.242644 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-49db3b1b-e563-4029-9d51-5577bb8170b6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:03.248883 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-49db3b1b-e563-4029-9d51-5577bb8170b6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:03.249328 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-49db3b1b-e563-4029-9d51-5577bb8170b6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:03.250100 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-49db3b1b-e563-4029-9d51-5577bb8170b6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:03.250530 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-49db3b1b-e563-4029-9d51-5577bb8170b6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:03.282327 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-49db3b1b-e563-4029-9d51-5577bb8170b6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044592 Aug 10 03:44:03.282879 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 444/876] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:03 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:44:03.812111 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-5a13eb3e-c87a-4d7e-81af-294aec85c328 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:03.814252 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-5a13eb3e-c87a-4d7e-81af-294aec85c328 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:03.829618 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5a13eb3e-c87a-4d7e-81af-294aec85c328 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:03.830092 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5a13eb3e-c87a-4d7e-81af-294aec85c328 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:03.830902 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5a13eb3e-c87a-4d7e-81af-294aec85c328 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:03.831345 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5a13eb3e-c87a-4d7e-81af-294aec85c328 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:03.971725 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-5a13eb3e-c87a-4d7e-81af-294aec85c328 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:03.979652 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-5a13eb3e-c87a-4d7e-81af-294aec85c328 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.172628 Aug 10 03:44:03.982437 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 433/877] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:03 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:04.294200 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d512132b-ee5b-4aa0-8717-a4e71d2ccb33 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:04.295764 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d512132b-ee5b-4aa0-8717-a4e71d2ccb33 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:04.302465 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d512132b-ee5b-4aa0-8717-a4e71d2ccb33 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:04.302917 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d512132b-ee5b-4aa0-8717-a4e71d2ccb33 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:04.303908 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d512132b-ee5b-4aa0-8717-a4e71d2ccb33 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:04.304387 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d512132b-ee5b-4aa0-8717-a4e71d2ccb33 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:04.337923 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d512132b-ee5b-4aa0-8717-a4e71d2ccb33 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047637 Aug 10 03:44:04.338670 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 445/878] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:04 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:44:05.001299 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-cf26ee91-67a2-4724-af2c-49488d3fe88f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:05.002023 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-cf26ee91-67a2-4724-af2c-49488d3fe88f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:05.007813 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cf26ee91-67a2-4724-af2c-49488d3fe88f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:05.008276 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cf26ee91-67a2-4724-af2c-49488d3fe88f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:05.009222 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cf26ee91-67a2-4724-af2c-49488d3fe88f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:05.009784 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cf26ee91-67a2-4724-af2c-49488d3fe88f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:05.148830 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-cf26ee91-67a2-4724-af2c-49488d3fe88f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:05.156588 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-cf26ee91-67a2-4724-af2c-49488d3fe88f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.162562 Aug 10 03:44:05.157155 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 434/879] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:04 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:05.388800 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-037e8512-3284-472f-8264-a37de18d610c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:05.388800 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-037e8512-3284-472f-8264-a37de18d610c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:05.388800 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-037e8512-3284-472f-8264-a37de18d610c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:05.388800 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-037e8512-3284-472f-8264-a37de18d610c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:05.389810 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-037e8512-3284-472f-8264-a37de18d610c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:05.389810 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-037e8512-3284-472f-8264-a37de18d610c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:05.399800 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-037e8512-3284-472f-8264-a37de18d610c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054161 Aug 10 03:44:05.400408 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 446/880] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:05 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:44:06.175959 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-39adb205-cc4c-4225-a5de-8642b4cf7963 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:06.177468 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-39adb205-cc4c-4225-a5de-8642b4cf7963 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:06.184281 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-39adb205-cc4c-4225-a5de-8642b4cf7963 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:06.184719 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-39adb205-cc4c-4225-a5de-8642b4cf7963 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:06.185492 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-39adb205-cc4c-4225-a5de-8642b4cf7963 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:06.185919 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-39adb205-cc4c-4225-a5de-8642b4cf7963 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:06.313409 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-39adb205-cc4c-4225-a5de-8642b4cf7963 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:06.320673 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-39adb205-cc4c-4225-a5de-8642b4cf7963 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.149905 Aug 10 03:44:06.321228 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 435/881] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:06 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:06.413119 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f1b2b6dc-1655-41f7-8ae4-3432d49393fd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:06.414143 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f1b2b6dc-1655-41f7-8ae4-3432d49393fd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:06.434806 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f1b2b6dc-1655-41f7-8ae4-3432d49393fd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:06.435573 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f1b2b6dc-1655-41f7-8ae4-3432d49393fd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:06.436680 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f1b2b6dc-1655-41f7-8ae4-3432d49393fd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:06.437325 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f1b2b6dc-1655-41f7-8ae4-3432d49393fd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:06.469777 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f1b2b6dc-1655-41f7-8ae4-3432d49393fd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060934 Aug 10 03:44:06.470520 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 447/882] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:06 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:44:07.338667 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-bc64b99c-49be-40ce-ab35-d3dedf132342 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:07.339395 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-bc64b99c-49be-40ce-ab35-d3dedf132342 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:07.346631 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bc64b99c-49be-40ce-ab35-d3dedf132342 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:07.347403 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bc64b99c-49be-40ce-ab35-d3dedf132342 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:07.348634 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bc64b99c-49be-40ce-ab35-d3dedf132342 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:07.349232 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bc64b99c-49be-40ce-ab35-d3dedf132342 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:07.475460 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-bc64b99c-49be-40ce-ab35-d3dedf132342 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:07.483875 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6ca42a4a-cad7-4af7-b3fa-339ca7a3f976 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:07.487758 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6ca42a4a-cad7-4af7-b3fa-339ca7a3f976 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:07.498095 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6ca42a4a-cad7-4af7-b3fa-339ca7a3f976 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:07.501242 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6ca42a4a-cad7-4af7-b3fa-339ca7a3f976 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:07.501242 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6ca42a4a-cad7-4af7-b3fa-339ca7a3f976 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:07.501242 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6ca42a4a-cad7-4af7-b3fa-339ca7a3f976 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:07.520422 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-bc64b99c-49be-40ce-ab35-d3dedf132342 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.185419 Aug 10 03:44:07.522327 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 436/883] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:07 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:07.556971 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6ca42a4a-cad7-4af7-b3fa-339ca7a3f976 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078788 Aug 10 03:44:07.560337 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 448/884] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:07 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:44:08.667699 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-24ad94e5-84f2-4528-8ec9-288cd58841db tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:08.667699 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-24ad94e5-84f2-4528-8ec9-288cd58841db tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:08.667699 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-24ad94e5-84f2-4528-8ec9-288cd58841db tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:08.667699 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-24ad94e5-84f2-4528-8ec9-288cd58841db tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:08.669964 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-24ad94e5-84f2-4528-8ec9-288cd58841db tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:08.669964 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-24ad94e5-84f2-4528-8ec9-288cd58841db tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:08.670196 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-13353c52-3c87-4b90-8f42-f215cb1ec20a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:08.670196 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-13353c52-3c87-4b90-8f42-f215cb1ec20a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:08.670196 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-13353c52-3c87-4b90-8f42-f215cb1ec20a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:08.670196 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-13353c52-3c87-4b90-8f42-f215cb1ec20a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:08.670846 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-13353c52-3c87-4b90-8f42-f215cb1ec20a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:08.670846 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-13353c52-3c87-4b90-8f42-f215cb1ec20a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:08.670846 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-13353c52-3c87-4b90-8f42-f215cb1ec20a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045786 Aug 10 03:44:08.670846 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 449/885] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:08 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:44:08.691659 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-24ad94e5-84f2-4528-8ec9-288cd58841db tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:08.703363 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-24ad94e5-84f2-4528-8ec9-288cd58841db tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.168986 Aug 10 03:44:08.705342 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 437/886] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:08 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:09.695623 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1e281631-b209-4946-bb45-857dcda3db9a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:09.700702 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1e281631-b209-4946-bb45-857dcda3db9a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:09.704690 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e281631-b209-4946-bb45-857dcda3db9a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:09.705243 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e281631-b209-4946-bb45-857dcda3db9a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:09.706135 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e281631-b209-4946-bb45-857dcda3db9a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:09.706563 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e281631-b209-4946-bb45-857dcda3db9a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:09.721430 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-5c214bf5-b494-46d7-841b-7e768792a086 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:09.722036 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-5c214bf5-b494-46d7-841b-7e768792a086 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:09.728044 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5c214bf5-b494-46d7-841b-7e768792a086 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:09.728559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5c214bf5-b494-46d7-841b-7e768792a086 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:09.729333 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5c214bf5-b494-46d7-841b-7e768792a086 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:09.729768 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5c214bf5-b494-46d7-841b-7e768792a086 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:09.737199 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1e281631-b209-4946-bb45-857dcda3db9a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056111 Aug 10 03:44:09.737757 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 450/887] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:09 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:44:09.873177 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-5c214bf5-b494-46d7-841b-7e768792a086 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:09.880676 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-5c214bf5-b494-46d7-841b-7e768792a086 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.162766 Aug 10 03:44:09.881237 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 438/888] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:09 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:10.748805 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0716fd89-8c95-446e-962c-c1e2f7f4b1a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:10.749786 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0716fd89-8c95-446e-962c-c1e2f7f4b1a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:10.755605 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0716fd89-8c95-446e-962c-c1e2f7f4b1a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:10.756038 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0716fd89-8c95-446e-962c-c1e2f7f4b1a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:10.756827 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0716fd89-8c95-446e-962c-c1e2f7f4b1a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:10.757250 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0716fd89-8c95-446e-962c-c1e2f7f4b1a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:10.786461 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0716fd89-8c95-446e-962c-c1e2f7f4b1a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041550 Aug 10 03:44:10.787020 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 451/889] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:10 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:44:10.897511 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e736d950-e994-43c4-8287-24f2a2622f0f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:10.898242 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e736d950-e994-43c4-8287-24f2a2622f0f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:10.904626 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e736d950-e994-43c4-8287-24f2a2622f0f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:10.905071 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e736d950-e994-43c4-8287-24f2a2622f0f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:10.905936 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e736d950-e994-43c4-8287-24f2a2622f0f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:10.906273 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e736d950-e994-43c4-8287-24f2a2622f0f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:11.026038 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e736d950-e994-43c4-8287-24f2a2622f0f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:11.033724 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e736d950-e994-43c4-8287-24f2a2622f0f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.139919 Aug 10 03:44:11.034282 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 439/890] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:10 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:11.798006 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-32a7358f-5263-45dd-8af1-0891a3dcf203 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:11.798900 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-32a7358f-5263-45dd-8af1-0891a3dcf203 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:11.805013 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-32a7358f-5263-45dd-8af1-0891a3dcf203 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:11.805481 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-32a7358f-5263-45dd-8af1-0891a3dcf203 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:11.806236 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-32a7358f-5263-45dd-8af1-0891a3dcf203 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:11.806723 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-32a7358f-5263-45dd-8af1-0891a3dcf203 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:11.837345 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-32a7358f-5263-45dd-8af1-0891a3dcf203 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043074 Aug 10 03:44:11.838037 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 452/891] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:11 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:44:12.050106 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e89e90b3-ab56-40f6-a2c6-427439256eb0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:12.050627 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e89e90b3-ab56-40f6-a2c6-427439256eb0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:12.056502 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e89e90b3-ab56-40f6-a2c6-427439256eb0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:12.056938 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e89e90b3-ab56-40f6-a2c6-427439256eb0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:12.057692 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e89e90b3-ab56-40f6-a2c6-427439256eb0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:12.058600 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e89e90b3-ab56-40f6-a2c6-427439256eb0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:12.177191 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e89e90b3-ab56-40f6-a2c6-427439256eb0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:12.184851 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e89e90b3-ab56-40f6-a2c6-427439256eb0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.138591 Aug 10 03:44:12.185413 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 440/892] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:12 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:12.849474 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-cdeebc0f-b89c-4467-b533-bb3e0fcb2224 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:12.850382 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-cdeebc0f-b89c-4467-b533-bb3e0fcb2224 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:12.856026 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cdeebc0f-b89c-4467-b533-bb3e0fcb2224 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:12.856502 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cdeebc0f-b89c-4467-b533-bb3e0fcb2224 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:12.857266 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cdeebc0f-b89c-4467-b533-bb3e0fcb2224 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:12.857699 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cdeebc0f-b89c-4467-b533-bb3e0fcb2224 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:12.891054 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-cdeebc0f-b89c-4467-b533-bb3e0fcb2224 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045229 Aug 10 03:44:12.891833 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 453/893] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:12 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:44:13.202516 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-56f7dbdc-f6ea-4c2b-a9ed-1be51c67a19c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:13.203127 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-56f7dbdc-f6ea-4c2b-a9ed-1be51c67a19c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:13.209400 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-56f7dbdc-f6ea-4c2b-a9ed-1be51c67a19c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:13.209850 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-56f7dbdc-f6ea-4c2b-a9ed-1be51c67a19c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:13.210631 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-56f7dbdc-f6ea-4c2b-a9ed-1be51c67a19c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:13.211065 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-56f7dbdc-f6ea-4c2b-a9ed-1be51c67a19c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:13.394176 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-56f7dbdc-f6ea-4c2b-a9ed-1be51c67a19c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:13.401549 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-56f7dbdc-f6ea-4c2b-a9ed-1be51c67a19c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.203166 Aug 10 03:44:13.402104 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 441/894] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:13 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:13.903078 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8f5832b3-9f04-4f2d-97f7-b6e6052380a5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:13.904053 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8f5832b3-9f04-4f2d-97f7-b6e6052380a5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:13.910478 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f5832b3-9f04-4f2d-97f7-b6e6052380a5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:13.910914 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f5832b3-9f04-4f2d-97f7-b6e6052380a5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:13.911671 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f5832b3-9f04-4f2d-97f7-b6e6052380a5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:13.912095 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f5832b3-9f04-4f2d-97f7-b6e6052380a5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:13.940565 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8f5832b3-9f04-4f2d-97f7-b6e6052380a5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041763 Aug 10 03:44:13.941126 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 454/895] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:13 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:44:14.418345 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-71b4a33d-fda1-4652-b144-55eb746ee522 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:14.418928 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-71b4a33d-fda1-4652-b144-55eb746ee522 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:14.424824 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-71b4a33d-fda1-4652-b144-55eb746ee522 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:14.425270 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-71b4a33d-fda1-4652-b144-55eb746ee522 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:14.426043 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-71b4a33d-fda1-4652-b144-55eb746ee522 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:14.426478 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-71b4a33d-fda1-4652-b144-55eb746ee522 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:14.549894 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-71b4a33d-fda1-4652-b144-55eb746ee522 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:14.557054 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-71b4a33d-fda1-4652-b144-55eb746ee522 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.142995 Aug 10 03:44:14.557992 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 442/896] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:14 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:14.952406 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0aeca2b2-8b14-46e2-8212-964285d59583 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:14.953306 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0aeca2b2-8b14-46e2-8212-964285d59583 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:14.959029 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0aeca2b2-8b14-46e2-8212-964285d59583 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:14.959472 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0aeca2b2-8b14-46e2-8212-964285d59583 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:14.960242 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0aeca2b2-8b14-46e2-8212-964285d59583 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:14.960673 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0aeca2b2-8b14-46e2-8212-964285d59583 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:14.989987 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0aeca2b2-8b14-46e2-8212-964285d59583 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041847 Aug 10 03:44:14.990780 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 455/897] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:14 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:44:15.572577 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0b770ff8-a45a-4e55-a99b-94d529b1c995 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:15.573185 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0b770ff8-a45a-4e55-a99b-94d529b1c995 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:15.579099 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0b770ff8-a45a-4e55-a99b-94d529b1c995 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:15.579539 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0b770ff8-a45a-4e55-a99b-94d529b1c995 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:15.580332 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0b770ff8-a45a-4e55-a99b-94d529b1c995 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:15.580767 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0b770ff8-a45a-4e55-a99b-94d529b1c995 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:15.701509 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0b770ff8-a45a-4e55-a99b-94d529b1c995 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:15.708919 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0b770ff8-a45a-4e55-a99b-94d529b1c995 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.140003 Aug 10 03:44:15.714946 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 443/898] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:15 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:16.001543 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-41a996fd-1f82-4909-ac23-999279d69ca4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:16.002448 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-41a996fd-1f82-4909-ac23-999279d69ca4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:16.011942 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-41a996fd-1f82-4909-ac23-999279d69ca4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:16.012754 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-41a996fd-1f82-4909-ac23-999279d69ca4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:16.014103 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-41a996fd-1f82-4909-ac23-999279d69ca4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:16.014923 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-41a996fd-1f82-4909-ac23-999279d69ca4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:16.048596 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-41a996fd-1f82-4909-ac23-999279d69ca4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050703 Aug 10 03:44:16.049159 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 456/899] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:15 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:44:16.454399 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-5bf6349d-8692-4bfd-ab58-08239e93c79f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:16.455497 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-5bf6349d-8692-4bfd-ab58-08239e93c79f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:16.461291 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5bf6349d-8692-4bfd-ab58-08239e93c79f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:16.461727 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5bf6349d-8692-4bfd-ab58-08239e93c79f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:16.462483 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5bf6349d-8692-4bfd-ab58-08239e93c79f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:16.462906 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5bf6349d-8692-4bfd-ab58-08239e93c79f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:16.497209 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-5bf6349d-8692-4bfd-ab58-08239e93c79f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045395 Aug 10 03:44:16.497209 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 444/900] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:44:16 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:44:16.580255 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3f59cad5-7cea-476e-8dc3-2a4639e14cb7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:16.580750 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3f59cad5-7cea-476e-8dc3-2a4639e14cb7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:16.586480 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3f59cad5-7cea-476e-8dc3-2a4639e14cb7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:16.586921 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3f59cad5-7cea-476e-8dc3-2a4639e14cb7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:16.587683 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3f59cad5-7cea-476e-8dc3-2a4639e14cb7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:16.588107 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3f59cad5-7cea-476e-8dc3-2a4639e14cb7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:16.611923 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3f59cad5-7cea-476e-8dc3-2a4639e14cb7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Going to try to terminate instance {{(pid=108439) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:44:16.724947 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-856d1b71-c421-4dfb-817b-b62e8acface4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:16.725540 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-856d1b71-c421-4dfb-817b-b62e8acface4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:16.731366 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-856d1b71-c421-4dfb-817b-b62e8acface4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:16.731809 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-856d1b71-c421-4dfb-817b-b62e8acface4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:16.732667 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-856d1b71-c421-4dfb-817b-b62e8acface4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:16.733357 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-856d1b71-c421-4dfb-817b-b62e8acface4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:16.969591 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3f59cad5-7cea-476e-8dc3-2a4639e14cb7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "DELETE /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 204 len: 0 microversion: 2.1 time: 0.392311 Aug 10 03:44:16.969832 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 457/901] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:44:16 2021] DELETE /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:44:16.980348 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-73baf29a-62f6-415a-a850-6d7be7fea98e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:16.980348 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-73baf29a-62f6-415a-a850-6d7be7fea98e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:16.988341 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-73baf29a-62f6-415a-a850-6d7be7fea98e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:16.988906 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-73baf29a-62f6-415a-a850-6d7be7fea98e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:16.990096 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-73baf29a-62f6-415a-a850-6d7be7fea98e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:16.990626 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-73baf29a-62f6-415a-a850-6d7be7fea98e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:17.017200 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-856d1b71-c421-4dfb-817b-b62e8acface4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:17.026034 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-856d1b71-c421-4dfb-817b-b62e8acface4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.304702 Aug 10 03:44:17.038490 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 445/902] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:16 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:17.060789 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-fa7187be-3273-45b0-943d-aecf080a0827 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:17.061937 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-fa7187be-3273-45b0-943d-aecf080a0827 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:17.068427 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fa7187be-3273-45b0-943d-aecf080a0827 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:17.068924 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fa7187be-3273-45b0-943d-aecf080a0827 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:17.069923 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fa7187be-3273-45b0-943d-aecf080a0827 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:17.070472 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fa7187be-3273-45b0-943d-aecf080a0827 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:17.112056 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-fa7187be-3273-45b0-943d-aecf080a0827 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053036 Aug 10 03:44:17.112056 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 446/903] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:17 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:44:17.158476 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0c7b74b2-519b-40c5-9dcb-43188b12c556 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:17.159066 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0c7b74b2-519b-40c5-9dcb-43188b12c556 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:17.165246 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0c7b74b2-519b-40c5-9dcb-43188b12c556 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:17.165724 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0c7b74b2-519b-40c5-9dcb-43188b12c556 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:17.166521 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0c7b74b2-519b-40c5-9dcb-43188b12c556 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:17.166954 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0c7b74b2-519b-40c5-9dcb-43188b12c556 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:17.192085 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0c7b74b2-519b-40c5-9dcb-43188b12c556 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Going to try to terminate instance {{(pid=108440) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:44:17.214357 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-73baf29a-62f6-415a-a850-6d7be7fea98e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:17.222142 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-73baf29a-62f6-415a-a850-6d7be7fea98e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1674 microversion: 2.1 time: 0.247877 Aug 10 03:44:17.222794 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 458/904] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:16 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1674 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:17.500251 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0c7b74b2-519b-40c5-9dcb-43188b12c556 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 204 len: 0 microversion: 2.1 time: 0.345474 Aug 10 03:44:17.501118 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 447/905] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:44:17 2021] DELETE /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 03:44:17.510704 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-16c7d575-8500-4430-afe2-2b11b82c7648 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:17.510704 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-16c7d575-8500-4430-afe2-2b11b82c7648 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:17.515498 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16c7d575-8500-4430-afe2-2b11b82c7648 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:17.515938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16c7d575-8500-4430-afe2-2b11b82c7648 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:17.516838 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16c7d575-8500-4430-afe2-2b11b82c7648 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:17.517295 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16c7d575-8500-4430-afe2-2b11b82c7648 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:17.646235 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-16c7d575-8500-4430-afe2-2b11b82c7648 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:17.655079 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-16c7d575-8500-4430-afe2-2b11b82c7648 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1512 microversion: 2.1 time: 0.149840 Aug 10 03:44:17.655690 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 459/906] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:17 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:18.046302 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-88c50ef4-5cca-45d3-b4fc-4c5e360b63b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:18.046916 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-88c50ef4-5cca-45d3-b4fc-4c5e360b63b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:18.052866 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-88c50ef4-5cca-45d3-b4fc-4c5e360b63b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:18.053310 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-88c50ef4-5cca-45d3-b4fc-4c5e360b63b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:18.054238 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-88c50ef4-5cca-45d3-b4fc-4c5e360b63b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:18.054667 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-88c50ef4-5cca-45d3-b4fc-4c5e360b63b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:18.123913 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e84a583e-31f1-4dae-aa4f-1c645b0422fe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:18.125465 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e84a583e-31f1-4dae-aa4f-1c645b0422fe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:18.133269 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e84a583e-31f1-4dae-aa4f-1c645b0422fe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:18.133560 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e84a583e-31f1-4dae-aa4f-1c645b0422fe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:18.134555 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e84a583e-31f1-4dae-aa4f-1c645b0422fe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:18.134983 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e84a583e-31f1-4dae-aa4f-1c645b0422fe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:18.167024 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e84a583e-31f1-4dae-aa4f-1c645b0422fe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049301 Aug 10 03:44:18.167636 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 460/907] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:18 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:44:18.184281 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-88c50ef4-5cca-45d3-b4fc-4c5e360b63b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:18.191514 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-88c50ef4-5cca-45d3-b4fc-4c5e360b63b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.149429 Aug 10 03:44:18.192289 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 448/908] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:18 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:18.240124 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6303a82c-852a-4a3a-b8a4-90b3f441dfd5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:18.240818 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6303a82c-852a-4a3a-b8a4-90b3f441dfd5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:18.247682 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6303a82c-852a-4a3a-b8a4-90b3f441dfd5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:18.248121 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6303a82c-852a-4a3a-b8a4-90b3f441dfd5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:18.248904 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6303a82c-852a-4a3a-b8a4-90b3f441dfd5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:18.249459 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6303a82c-852a-4a3a-b8a4-90b3f441dfd5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:18.374840 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6303a82c-852a-4a3a-b8a4-90b3f441dfd5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:18.382940 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6303a82c-852a-4a3a-b8a4-90b3f441dfd5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1674 microversion: 2.1 time: 0.146833 Aug 10 03:44:18.384644 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 461/909] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:18 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:18.671958 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3d4588a2-faac-412f-9222-33fed5e54acc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:18.672597 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3d4588a2-faac-412f-9222-33fed5e54acc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:18.678579 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3d4588a2-faac-412f-9222-33fed5e54acc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:18.679040 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3d4588a2-faac-412f-9222-33fed5e54acc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:18.679827 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3d4588a2-faac-412f-9222-33fed5e54acc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:18.680278 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3d4588a2-faac-412f-9222-33fed5e54acc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:18.800966 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3d4588a2-faac-412f-9222-33fed5e54acc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:18.808845 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3d4588a2-faac-412f-9222-33fed5e54acc tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1512 microversion: 2.1 time: 0.139928 Aug 10 03:44:18.809403 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 449/910] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:18 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1512 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:19.178743 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-4ade0894-e0b6-416c-9843-30d011946a6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:19.179729 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-4ade0894-e0b6-416c-9843-30d011946a6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:19.186560 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4ade0894-e0b6-416c-9843-30d011946a6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:19.187081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4ade0894-e0b6-416c-9843-30d011946a6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:19.187845 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4ade0894-e0b6-416c-9843-30d011946a6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:19.188303 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4ade0894-e0b6-416c-9843-30d011946a6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:19.208873 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c89f9de7-b54b-46a9-9d6c-91ec61b766b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:19.209498 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c89f9de7-b54b-46a9-9d6c-91ec61b766b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:19.216942 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-4ade0894-e0b6-416c-9843-30d011946a6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041894 Aug 10 03:44:19.217368 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c89f9de7-b54b-46a9-9d6c-91ec61b766b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:19.217489 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 462/911] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:44:19 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:19.217812 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c89f9de7-b54b-46a9-9d6c-91ec61b766b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:19.218905 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c89f9de7-b54b-46a9-9d6c-91ec61b766b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:19.219519 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c89f9de7-b54b-46a9-9d6c-91ec61b766b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:19.282995 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-024c57e2-2bb0-4f70-b10c-dfeca56999c4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:19.283565 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-024c57e2-2bb0-4f70-b10c-dfeca56999c4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:19.289453 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-024c57e2-2bb0-4f70-b10c-dfeca56999c4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:19.289901 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-024c57e2-2bb0-4f70-b10c-dfeca56999c4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:19.290669 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-024c57e2-2bb0-4f70-b10c-dfeca56999c4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:19.291100 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-024c57e2-2bb0-4f70-b10c-dfeca56999c4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:19.317260 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-024c57e2-2bb0-4f70-b10c-dfeca56999c4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Going to try to terminate instance {{(pid=108439) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:44:19.350161 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c89f9de7-b54b-46a9-9d6c-91ec61b766b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:19.357845 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c89f9de7-b54b-46a9-9d6c-91ec61b766b3 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.152783 Aug 10 03:44:19.358668 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 450/912] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:19 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:19.399883 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a848ddee-a0f2-44de-be7a-c6a9bdf70bf1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:19.400570 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a848ddee-a0f2-44de-be7a-c6a9bdf70bf1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:19.406534 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a848ddee-a0f2-44de-be7a-c6a9bdf70bf1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:19.406977 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a848ddee-a0f2-44de-be7a-c6a9bdf70bf1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:19.409192 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a848ddee-a0f2-44de-be7a-c6a9bdf70bf1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:19.409192 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a848ddee-a0f2-44de-be7a-c6a9bdf70bf1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:19.536551 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a848ddee-a0f2-44de-be7a-c6a9bdf70bf1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:19.545442 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a848ddee-a0f2-44de-be7a-c6a9bdf70bf1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1674 microversion: 2.1 time: 0.148741 Aug 10 03:44:19.545948 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-024c57e2-2bb0-4f70-b10c-dfeca56999c4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "DELETE /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 204 len: 0 microversion: 2.20 time: 0.266421 Aug 10 03:44:19.546484 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 451/913] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:19 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:19.547068 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 463/914] 10.222.0.21 () {60 vars in 1280 bytes} [Tue Aug 10 03:44:19 2021] DELETE /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 03:44:19.559931 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-5146e456-9bce-4826-848b-0a60d429e550 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:19.559931 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-5146e456-9bce-4826-848b-0a60d429e550 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:19.561987 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5146e456-9bce-4826-848b-0a60d429e550 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:19.562435 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5146e456-9bce-4826-848b-0a60d429e550 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:19.563204 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5146e456-9bce-4826-848b-0a60d429e550 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:19.563638 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-5146e456-9bce-4826-848b-0a60d429e550 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:19.686670 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-5146e456-9bce-4826-848b-0a60d429e550 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:19.694435 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-5146e456-9bce-4826-848b-0a60d429e550 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:19.696167 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-5146e456-9bce-4826-848b-0a60d429e550 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:19.697334 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-5146e456-9bce-4826-848b-0a60d429e550 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.145849 Aug 10 03:44:19.709668 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 452/915] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:19 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:19.826347 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-94874d86-8ccb-440c-a320-3aecf79d7b95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:19.827123 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-94874d86-8ccb-440c-a320-3aecf79d7b95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:19.833330 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94874d86-8ccb-440c-a320-3aecf79d7b95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:19.834044 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94874d86-8ccb-440c-a320-3aecf79d7b95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:19.835009 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94874d86-8ccb-440c-a320-3aecf79d7b95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:19.835680 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94874d86-8ccb-440c-a320-3aecf79d7b95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:19.983640 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-94874d86-8ccb-440c-a320-3aecf79d7b95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:19.991544 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-94874d86-8ccb-440c-a320-3aecf79d7b95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1512 microversion: 2.1 time: 0.169659 Aug 10 03:44:19.992187 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 464/916] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:19 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:20.375422 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-75d2bd66-ae53-4b83-a63e-68d3d1052993 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:20.376031 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-75d2bd66-ae53-4b83-a63e-68d3d1052993 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:20.382662 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-75d2bd66-ae53-4b83-a63e-68d3d1052993 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:20.383148 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-75d2bd66-ae53-4b83-a63e-68d3d1052993 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:20.383926 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-75d2bd66-ae53-4b83-a63e-68d3d1052993 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:20.384390 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-75d2bd66-ae53-4b83-a63e-68d3d1052993 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:20.564998 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e43a3e03-29a0-411d-8af7-5ee65b9e874d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:20.565682 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e43a3e03-29a0-411d-8af7-5ee65b9e874d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:20.571457 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e43a3e03-29a0-411d-8af7-5ee65b9e874d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:20.571987 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e43a3e03-29a0-411d-8af7-5ee65b9e874d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:20.572787 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e43a3e03-29a0-411d-8af7-5ee65b9e874d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:20.573215 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e43a3e03-29a0-411d-8af7-5ee65b9e874d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:20.701553 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e43a3e03-29a0-411d-8af7-5ee65b9e874d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:20.709483 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e43a3e03-29a0-411d-8af7-5ee65b9e874d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1674 microversion: 2.1 time: 0.148237 Aug 10 03:44:20.710071 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 465/917] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:20 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:20.722090 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6b836146-ea90-406c-90c0-f4a8474a34d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:20.722711 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6b836146-ea90-406c-90c0-f4a8474a34d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:20.728853 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6b836146-ea90-406c-90c0-f4a8474a34d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:20.729308 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6b836146-ea90-406c-90c0-f4a8474a34d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:20.730617 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6b836146-ea90-406c-90c0-f4a8474a34d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:20.731080 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6b836146-ea90-406c-90c0-f4a8474a34d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:20.875688 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6b836146-ea90-406c-90c0-f4a8474a34d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:20.884104 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6b836146-ea90-406c-90c0-f4a8474a34d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:20.885676 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6b836146-ea90-406c-90c0-f4a8474a34d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:20.886939 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6b836146-ea90-406c-90c0-f4a8474a34d7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.168829 Aug 10 03:44:20.887509 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 466/918] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:20 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:20.927412 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-75d2bd66-ae53-4b83-a63e-68d3d1052993 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:20.935471 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-75d2bd66-ae53-4b83-a63e-68d3d1052993 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.563808 Aug 10 03:44:20.939370 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 453/919] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:20 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:21.009214 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-16445fbb-709b-4868-855e-5d49855a0412 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:21.014450 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-16445fbb-709b-4868-855e-5d49855a0412 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:21.016645 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16445fbb-709b-4868-855e-5d49855a0412 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:21.017792 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16445fbb-709b-4868-855e-5d49855a0412 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:21.019092 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16445fbb-709b-4868-855e-5d49855a0412 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:21.019530 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16445fbb-709b-4868-855e-5d49855a0412 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:21.096583 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-16445fbb-709b-4868-855e-5d49855a0412 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:21.104176 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-16445fbb-709b-4868-855e-5d49855a0412 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1470 microversion: 2.1 time: 0.098599 Aug 10 03:44:21.104801 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 467/920] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:21 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1470 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:21.157407 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-54335e1d-ed27-44ca-90a1-84fad12beb27 req-e61944dc-1515-4cad-8889-c27be53eb66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc93e7b-20ee-49c2-8f30-c97c884a1118", "name": "network-vif-deleted", "tag": "096af4bc-acc2-42b7-8512-7a1b982bef27"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:21.162617 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:44:21.162617 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:44:21.171782 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-54335e1d-ed27-44ca-90a1-84fad12beb27 req-e61944dc-1515-4cad-8889-c27be53eb66a service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:21.173209 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-54335e1d-ed27-44ca-90a1-84fad12beb27 req-e61944dc-1515-4cad-8889-c27be53eb66a service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:21.189103 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-54335e1d-ed27-44ca-90a1-84fad12beb27 req-e61944dc-1515-4cad-8889-c27be53eb66a service nova] Creating event network-vif-deleted:096af4bc-acc2-42b7-8512-7a1b982bef27 for instance 1dc93e7b-20ee-49c2-8f30-c97c884a1118 on hv-cinder-78239 Aug 10 03:44:21.194323 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-54335e1d-ed27-44ca-90a1-84fad12beb27 req-e61944dc-1515-4cad-8889-c27be53eb66a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043339 Aug 10 03:44:21.195419 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 454/921] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:44:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:44:21.729283 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a23da2e5-3941-4673-985d-1915334685eb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:21.730514 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a23da2e5-3941-4673-985d-1915334685eb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:21.738168 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a23da2e5-3941-4673-985d-1915334685eb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:21.738609 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a23da2e5-3941-4673-985d-1915334685eb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:21.748879 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a23da2e5-3941-4673-985d-1915334685eb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:21.758011 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a23da2e5-3941-4673-985d-1915334685eb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:21.850577 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a23da2e5-3941-4673-985d-1915334685eb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:21.864795 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a23da2e5-3941-4673-985d-1915334685eb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1606 microversion: 2.1 time: 0.135882 Aug 10 03:44:21.875016 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 468/922] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:21 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1606 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:21.916022 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6833971a-e768-4898-8152-400a29cd3188 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:21.916648 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6833971a-e768-4898-8152-400a29cd3188 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:21.929825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6833971a-e768-4898-8152-400a29cd3188 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:21.930267 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6833971a-e768-4898-8152-400a29cd3188 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:21.931718 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6833971a-e768-4898-8152-400a29cd3188 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:21.932367 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6833971a-e768-4898-8152-400a29cd3188 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:21.960042 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6b507b68-a28f-4bd0-a580-9a88a5d85cd8 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:21.961646 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6b507b68-a28f-4bd0-a580-9a88a5d85cd8 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:21.999636 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6b507b68-a28f-4bd0-a580-9a88a5d85cd8 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:22.002740 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6b507b68-a28f-4bd0-a580-9a88a5d85cd8 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:22.003830 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6b507b68-a28f-4bd0-a580-9a88a5d85cd8 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:22.004480 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6b507b68-a28f-4bd0-a580-9a88a5d85cd8 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:22.268241 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6833971a-e768-4898-8152-400a29cd3188 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:22.307051 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6833971a-e768-4898-8152-400a29cd3188 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:22.312214 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6833971a-e768-4898-8152-400a29cd3188 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:22.317754 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6833971a-e768-4898-8152-400a29cd3188 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1723 microversion: 2.20 time: 0.405952 Aug 10 03:44:22.318503 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 455/923] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:21 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1723 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:22.331254 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e1fcc10f-0578-4563-ada7-089748ede9bb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:22.333884 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e1fcc10f-0578-4563-ada7-089748ede9bb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:22.353203 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e1fcc10f-0578-4563-ada7-089748ede9bb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:22.356690 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e1fcc10f-0578-4563-ada7-089748ede9bb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:22.357606 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e1fcc10f-0578-4563-ada7-089748ede9bb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:22.358297 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e1fcc10f-0578-4563-ada7-089748ede9bb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:22.446182 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e1fcc10f-0578-4563-ada7-089748ede9bb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:22.446748 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e1fcc10f-0578-4563-ada7-089748ede9bb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:22.447210 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-e1fcc10f-0578-4563-ada7-089748ede9bb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lazy-loading 'fault' on Instance uuid 1dc93e7b-20ee-49c2-8f30-c97c884a1118 {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:44:22.509617 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e1fcc10f-0578-4563-ada7-089748ede9bb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:22.525525 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e1fcc10f-0578-4563-ada7-089748ede9bb tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 200 len: 1308 microversion: 2.1 time: 0.204045 Aug 10 03:44:22.525525 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 456/924] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:22 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 1308 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:22.693527 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6b507b68-a28f-4bd0-a580-9a88a5d85cd8 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:22.705610 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6b507b68-a28f-4bd0-a580-9a88a5d85cd8 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.754235 Aug 10 03:44:22.706254 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 469/925] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:21 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:22.888743 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-cfcff71d-49b8-4d7f-bcbf-8ad15ee64ecb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:22.897480 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-cfcff71d-49b8-4d7f-bcbf-8ad15ee64ecb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:22.928927 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cfcff71d-49b8-4d7f-bcbf-8ad15ee64ecb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:22.931543 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cfcff71d-49b8-4d7f-bcbf-8ad15ee64ecb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:22.933305 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cfcff71d-49b8-4d7f-bcbf-8ad15ee64ecb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:22.935188 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cfcff71d-49b8-4d7f-bcbf-8ad15ee64ecb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:23.013566 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cfcff71d-49b8-4d7f-bcbf-8ad15ee64ecb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:23.013922 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cfcff71d-49b8-4d7f-bcbf-8ad15ee64ecb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:23.014370 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-cfcff71d-49b8-4d7f-bcbf-8ad15ee64ecb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lazy-loading 'fault' on Instance uuid 8b3a59e0-96ca-48a8-a62f-c6fef743ce89 {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:44:23.169737 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-cfcff71d-49b8-4d7f-bcbf-8ad15ee64ecb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:23.185126 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-cfcff71d-49b8-4d7f-bcbf-8ad15ee64ecb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 200 len: 1327 microversion: 2.1 time: 0.307453 Aug 10 03:44:23.185710 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 457/926] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:22 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 1327 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:23.220422 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-746689c0-5e14-44cb-bcac-2b52f1ca641e req-76dec5d7-576b-4158-8ea7-536998fc012f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b3a59e0-96ca-48a8-a62f-c6fef743ce89", "name": "network-vif-deleted", "tag": "12cb09a3-9484-46a1-8f5c-54e53b12470c"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:23.223022 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:44:23.223022 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:44:23.238956 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-746689c0-5e14-44cb-bcac-2b52f1ca641e req-76dec5d7-576b-4158-8ea7-536998fc012f service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:23.239688 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-746689c0-5e14-44cb-bcac-2b52f1ca641e req-76dec5d7-576b-4158-8ea7-536998fc012f service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:23.261758 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-746689c0-5e14-44cb-bcac-2b52f1ca641e req-76dec5d7-576b-4158-8ea7-536998fc012f service nova] Creating event network-vif-deleted:12cb09a3-9484-46a1-8f5c-54e53b12470c for instance 8b3a59e0-96ca-48a8-a62f-c6fef743ce89 on hv-cinder-78239 Aug 10 03:44:23.269147 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-746689c0-5e14-44cb-bcac-2b52f1ca641e req-76dec5d7-576b-4158-8ea7-536998fc012f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052074 Aug 10 03:44:23.270272 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 470/927] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:44:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:44:23.338911 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-9edb2c00-2d4a-4229-bf96-18d3d188e9f5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:23.340138 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-9edb2c00-2d4a-4229-bf96-18d3d188e9f5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:23.362556 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9edb2c00-2d4a-4229-bf96-18d3d188e9f5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:23.367147 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9edb2c00-2d4a-4229-bf96-18d3d188e9f5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:23.368170 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9edb2c00-2d4a-4229-bf96-18d3d188e9f5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:23.368877 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9edb2c00-2d4a-4229-bf96-18d3d188e9f5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:23.411397 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-2a55b011-96ed-48c9-8d2b-e2353370643d req-4a0357d0-27b9-458a-9b08-01593408d4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2969b784-ae47-4dce-a4d1-f86c2d508de8", "name": "network-vif-plugged", "status": "completed", "tag": "e4c32421-6086-4a06-97cd-96e3d3edc391"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:23.413483 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:44:23.413483 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:44:23.428314 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-2a55b011-96ed-48c9-8d2b-e2353370643d req-4a0357d0-27b9-458a-9b08-01593408d4f4 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:23.428314 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-2a55b011-96ed-48c9-8d2b-e2353370643d req-4a0357d0-27b9-458a-9b08-01593408d4f4 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:23.454214 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-2a55b011-96ed-48c9-8d2b-e2353370643d req-4a0357d0-27b9-458a-9b08-01593408d4f4 service nova] Creating event network-vif-plugged:e4c32421-6086-4a06-97cd-96e3d3edc391 for instance 2969b784-ae47-4dce-a4d1-f86c2d508de8 on hv-cinder-78239 Aug 10 03:44:23.460172 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-2a55b011-96ed-48c9-8d2b-e2353370643d req-4a0357d0-27b9-458a-9b08-01593408d4f4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053041 Aug 10 03:44:23.461844 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 471/928] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:44:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:44:23.539449 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9edb2c00-2d4a-4229-bf96-18d3d188e9f5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:23.553502 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c1a2413a-5c16-4ea4-9b02-05ca9db97632 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:23.555526 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c1a2413a-5c16-4ea4-9b02-05ca9db97632 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 1dc93e7b-20ee-49c2-8f30-c97c884a1118] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:23.565277 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9edb2c00-2d4a-4229-bf96-18d3d188e9f5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:23.573430 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9edb2c00-2d4a-4229-bf96-18d3d188e9f5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:23.583569 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-9edb2c00-2d4a-4229-bf96-18d3d188e9f5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1655 microversion: 2.20 time: 0.250126 Aug 10 03:44:23.591444 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 458/929] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:23 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1655 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:23.599158 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c1a2413a-5c16-4ea4-9b02-05ca9db97632 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:23.600425 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c1a2413a-5c16-4ea4-9b02-05ca9db97632 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:23.602460 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c1a2413a-5c16-4ea4-9b02-05ca9db97632 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:23.624728 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c1a2413a-5c16-4ea4-9b02-05ca9db97632 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:23.656710 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-c1a2413a-5c16-4ea4-9b02-05ca9db97632 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] HTTP exception thrown: Instance 1dc93e7b-20ee-49c2-8f30-c97c884a1118 could not be found. Aug 10 03:44:23.658369 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c1a2413a-5c16-4ea4-9b02-05ca9db97632 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Returning 404 to user: Instance 1dc93e7b-20ee-49c2-8f30-c97c884a1118 could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:44:23.662103 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c1a2413a-5c16-4ea4-9b02-05ca9db97632 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118" status: 404 len: 111 microversion: 2.1 time: 0.116373 Aug 10 03:44:23.663308 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 472/930] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:23 2021] GET /compute/v2.1/servers/1dc93e7b-20ee-49c2-8f30-c97c884a1118 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:44:23.725801 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-defc692c-2592-4444-be12-09a1e3126361 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:23.727793 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-defc692c-2592-4444-be12-09a1e3126361 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:23.745059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-defc692c-2592-4444-be12-09a1e3126361 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:23.750514 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-defc692c-2592-4444-be12-09a1e3126361 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:23.755480 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-defc692c-2592-4444-be12-09a1e3126361 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:23.758322 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-defc692c-2592-4444-be12-09a1e3126361 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:24.088846 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-defc692c-2592-4444-be12-09a1e3126361 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:24.097931 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-defc692c-2592-4444-be12-09a1e3126361 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.377651 Aug 10 03:44:24.104473 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 459/931] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:23 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:24.208302 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c22d726f-7461-49eb-9096-568e9b566b6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:24.209332 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c22d726f-7461-49eb-9096-568e9b566b6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:24.220489 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c22d726f-7461-49eb-9096-568e9b566b6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:24.222285 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c22d726f-7461-49eb-9096-568e9b566b6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:24.224900 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c22d726f-7461-49eb-9096-568e9b566b6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:24.226445 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c22d726f-7461-49eb-9096-568e9b566b6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:24.258639 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-c22d726f-7461-49eb-9096-568e9b566b6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] HTTP exception thrown: Instance 8b3a59e0-96ca-48a8-a62f-c6fef743ce89 could not be found. Aug 10 03:44:24.259245 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c22d726f-7461-49eb-9096-568e9b566b6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Returning 404 to user: Instance 8b3a59e0-96ca-48a8-a62f-c6fef743ce89 could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:44:24.260135 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c22d726f-7461-49eb-9096-568e9b566b6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 404 len: 111 microversion: 2.1 time: 0.056965 Aug 10 03:44:24.260769 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 473/932] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:24 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:44:24.268888 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-557a0f99-9630-4158-9bd4-447d3546f3e6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '.version_select at 0x7f97a0128940>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:24.398769 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-557a0f99-9630-4158-9bd4-447d3546f3e6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045175388" status: 202 len: 0 microversion: 2.1 time: 0.133353 Aug 10 03:44:24.400645 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 460/933] 10.222.0.21 () {58 vars in 1221 bytes} [Tue Aug 10 03:44:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045175388 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:44:24.607515 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-13a8e1a9-57e2-4d9f-bd3c-7b8bce77f6b5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:24.615791 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-13a8e1a9-57e2-4d9f-bd3c-7b8bce77f6b5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:24.619540 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-13a8e1a9-57e2-4d9f-bd3c-7b8bce77f6b5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:24.620214 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-13a8e1a9-57e2-4d9f-bd3c-7b8bce77f6b5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:24.621224 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-13a8e1a9-57e2-4d9f-bd3c-7b8bce77f6b5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:24.621895 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-13a8e1a9-57e2-4d9f-bd3c-7b8bce77f6b5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:24.680527 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-13a8e1a9-57e2-4d9f-bd3c-7b8bce77f6b5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:24.682688 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-13a8e1a9-57e2-4d9f-bd3c-7b8bce77f6b5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:24.683195 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-13a8e1a9-57e2-4d9f-bd3c-7b8bce77f6b5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lazy-loading 'fault' on Instance uuid 0c599984-f271-4886-be2f-73e7531f52e4 {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:44:24.739092 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-13a8e1a9-57e2-4d9f-bd3c-7b8bce77f6b5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:24.748040 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-13a8e1a9-57e2-4d9f-bd3c-7b8bce77f6b5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:24.749848 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-13a8e1a9-57e2-4d9f-bd3c-7b8bce77f6b5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:24.751410 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-13a8e1a9-57e2-4d9f-bd3c-7b8bce77f6b5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1371 microversion: 2.20 time: 0.148757 Aug 10 03:44:24.753183 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 474/934] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:24 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:25.123226 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b6b4ff91-2d9e-46d0-8651-266ca8871649 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:25.123852 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b6b4ff91-2d9e-46d0-8651-266ca8871649 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:25.136138 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b6b4ff91-2d9e-46d0-8651-266ca8871649 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:25.136603 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b6b4ff91-2d9e-46d0-8651-266ca8871649 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:25.137606 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b6b4ff91-2d9e-46d0-8651-266ca8871649 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:25.138036 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b6b4ff91-2d9e-46d0-8651-266ca8871649 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:25.269657 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b6b4ff91-2d9e-46d0-8651-266ca8871649 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:25.286082 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b6b4ff91-2d9e-46d0-8651-266ca8871649 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.167117 Aug 10 03:44:25.286662 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 461/935] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:25 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:25.309520 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-a2c70165-229d-406b-b1ec-3e12d5140ee5 req-b27e9ceb-e019-49e4-8197-940cc709e7af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c599984-f271-4886-be2f-73e7531f52e4", "name": "network-vif-deleted", "tag": "54a387d8-dbe0-4a78-bbba-58f771dd4478"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:25.311742 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:44:25.311742 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:44:25.321829 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-a2c70165-229d-406b-b1ec-3e12d5140ee5 req-b27e9ceb-e019-49e4-8197-940cc709e7af service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:25.322538 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-a2c70165-229d-406b-b1ec-3e12d5140ee5 req-b27e9ceb-e019-49e4-8197-940cc709e7af service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:25.335112 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-a2c70165-229d-406b-b1ec-3e12d5140ee5 req-b27e9ceb-e019-49e4-8197-940cc709e7af service nova] Creating event network-vif-deleted:54a387d8-dbe0-4a78-bbba-58f771dd4478 for instance 0c599984-f271-4886-be2f-73e7531f52e4 on hv-cinder-78239 Aug 10 03:44:25.345449 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-a2c70165-229d-406b-b1ec-3e12d5140ee5 req-b27e9ceb-e019-49e4-8197-940cc709e7af service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039650 Aug 10 03:44:25.346500 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 475/936] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:44:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:44:25.518152 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-bbf63eea-75ae-4736-b0aa-9b6a1181ba47 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'create', calling method: .version_select at 0x7f97a01e3700>, body: {"keypair": {"name": "tempest-keypair-782982339"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:25.553026 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-bbf63eea-75ae-4736-b0aa-9b6a1181ba47 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Getting quotas for project db9e9e54834e4fe682d4305010655be7. Resources: {'key_pairs'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:44:25.562662 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-bbf63eea-75ae-4736-b0aa-9b6a1181ba47 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Getting quotas for user e2a2db05b54e45fba8475e7949a61d6a and project db9e9e54834e4fe682d4305010655be7. Resources: {'key_pairs'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:44:25.771611 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-74d7afbb-517a-43b6-8b84-419f86b170ed tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:25.772368 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-74d7afbb-517a-43b6-8b84-419f86b170ed tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:25.778381 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-74d7afbb-517a-43b6-8b84-419f86b170ed tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:25.778833 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-74d7afbb-517a-43b6-8b84-419f86b170ed tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:25.779579 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-74d7afbb-517a-43b6-8b84-419f86b170ed tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:25.780015 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-74d7afbb-517a-43b6-8b84-419f86b170ed tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:25.814968 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-74d7afbb-517a-43b6-8b84-419f86b170ed tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:25.815408 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-74d7afbb-517a-43b6-8b84-419f86b170ed tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:25.815853 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-74d7afbb-517a-43b6-8b84-419f86b170ed tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lazy-loading 'fault' on Instance uuid 0c599984-f271-4886-be2f-73e7531f52e4 {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:44:25.840791 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-bbf63eea-75ae-4736-b0aa-9b6a1181ba47 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Getting quotas for project db9e9e54834e4fe682d4305010655be7. Resources: {'key_pairs'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:44:25.844647 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-bbf63eea-75ae-4736-b0aa-9b6a1181ba47 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Getting quotas for user e2a2db05b54e45fba8475e7949a61d6a and project db9e9e54834e4fe682d4305010655be7. Resources: {'key_pairs'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:44:25.857555 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-74d7afbb-517a-43b6-8b84-419f86b170ed tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:25.861987 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-bbf63eea-75ae-4736-b0aa-9b6a1181ba47 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.347272 Aug 10 03:44:25.863081 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 462/937] 10.222.0.21 () {60 vars in 1158 bytes} [Tue Aug 10 03:44:25 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:25.868101 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-74d7afbb-517a-43b6-8b84-419f86b170ed tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:25.874730 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-74d7afbb-517a-43b6-8b84-419f86b170ed tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:25.874730 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-74d7afbb-517a-43b6-8b84-419f86b170ed tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1371 microversion: 2.20 time: 0.103261 Aug 10 03:44:25.876597 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 476/938] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:25 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:44:26.303131 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-118e289e-90c9-487e-b566-7a4e8aaa8746 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:26.308803 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-118e289e-90c9-487e-b566-7a4e8aaa8746 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:26.310446 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-118e289e-90c9-487e-b566-7a4e8aaa8746 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:26.310920 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-118e289e-90c9-487e-b566-7a4e8aaa8746 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:26.311695 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-118e289e-90c9-487e-b566-7a4e8aaa8746 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:26.312128 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-118e289e-90c9-487e-b566-7a4e8aaa8746 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:26.476343 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-118e289e-90c9-487e-b566-7a4e8aaa8746 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:26.484497 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-118e289e-90c9-487e-b566-7a4e8aaa8746 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.185369 Aug 10 03:44:26.488779 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 463/939] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:26 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:26.890914 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8f6942e2-8c2c-4e4e-8d81-d5e7cd067041 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:26.891360 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8f6942e2-8c2c-4e4e-8d81-d5e7cd067041 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:26.897735 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f6942e2-8c2c-4e4e-8d81-d5e7cd067041 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:26.897902 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f6942e2-8c2c-4e4e-8d81-d5e7cd067041 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:26.898573 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f6942e2-8c2c-4e4e-8d81-d5e7cd067041 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:26.899466 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f6942e2-8c2c-4e4e-8d81-d5e7cd067041 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:26.930677 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f6942e2-8c2c-4e4e-8d81-d5e7cd067041 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:26.931123 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8f6942e2-8c2c-4e4e-8d81-d5e7cd067041 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:26.931727 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-8f6942e2-8c2c-4e4e-8d81-d5e7cd067041 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lazy-loading 'fault' on Instance uuid 0c599984-f271-4886-be2f-73e7531f52e4 {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:44:26.972962 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8f6942e2-8c2c-4e4e-8d81-d5e7cd067041 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:26.981203 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8f6942e2-8c2c-4e4e-8d81-d5e7cd067041 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:26.982693 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8f6942e2-8c2c-4e4e-8d81-d5e7cd067041 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:26.984128 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8f6942e2-8c2c-4e4e-8d81-d5e7cd067041 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1371 microversion: 2.20 time: 0.098749 Aug 10 03:44:26.984804 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 477/940] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:26 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:27.501999 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-23a763b6-3b31-41f3-afbb-89f3f96e1af4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:27.502665 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-23a763b6-3b31-41f3-afbb-89f3f96e1af4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:27.508911 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-23a763b6-3b31-41f3-afbb-89f3f96e1af4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:27.509397 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-23a763b6-3b31-41f3-afbb-89f3f96e1af4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:27.510177 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-23a763b6-3b31-41f3-afbb-89f3f96e1af4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:27.510874 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-23a763b6-3b31-41f3-afbb-89f3f96e1af4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:27.737084 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-23a763b6-3b31-41f3-afbb-89f3f96e1af4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:27.745234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-23a763b6-3b31-41f3-afbb-89f3f96e1af4 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1358 microversion: 2.1 time: 0.246871 Aug 10 03:44:27.757574 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 464/941] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:27 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:28.006632 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-47da3665-dd31-4d20-b667-ea886d2fd9d6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:28.006632 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-47da3665-dd31-4d20-b667-ea886d2fd9d6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:28.009304 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47da3665-dd31-4d20-b667-ea886d2fd9d6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:28.009749 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47da3665-dd31-4d20-b667-ea886d2fd9d6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:28.010719 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47da3665-dd31-4d20-b667-ea886d2fd9d6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:28.011906 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47da3665-dd31-4d20-b667-ea886d2fd9d6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:28.046754 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47da3665-dd31-4d20-b667-ea886d2fd9d6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:28.047263 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47da3665-dd31-4d20-b667-ea886d2fd9d6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:28.047824 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-47da3665-dd31-4d20-b667-ea886d2fd9d6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lazy-loading 'fault' on Instance uuid 0c599984-f271-4886-be2f-73e7531f52e4 {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:44:28.301942 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-47da3665-dd31-4d20-b667-ea886d2fd9d6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:28.309288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-47da3665-dd31-4d20-b667-ea886d2fd9d6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:28.310761 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-47da3665-dd31-4d20-b667-ea886d2fd9d6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:28.311868 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-47da3665-dd31-4d20-b667-ea886d2fd9d6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 200 len: 1371 microversion: 2.20 time: 0.313358 Aug 10 03:44:28.312447 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 478/942] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:27 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:28.669990 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-930623123", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dcbb3fa8-aa0a-4b07-8830-48ada6a110cb"}], "security_groups": [{"name": "tempest-securitygroup--1259803101"}], "key_name": "tempest-keypair-782982339", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:28.768084 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-578f7852-03b0-4ad4-9be9-29216728cd43 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:28.770917 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-578f7852-03b0-4ad4-9be9-29216728cd43 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:28.777229 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-578f7852-03b0-4ad4-9be9-29216728cd43 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:28.778003 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-578f7852-03b0-4ad4-9be9-29216728cd43 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:28.779925 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.network.neutron [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] validate_networks() for [('dcbb3fa8-aa0a-4b07-8830-48ada6a110cb', None, None, None)] {{(pid=108440) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:44:28.785702 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-578f7852-03b0-4ad4-9be9-29216728cd43 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:28.786160 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-578f7852-03b0-4ad4-9be9-29216728cd43 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:28.927166 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-578f7852-03b0-4ad4-9be9-29216728cd43 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:28.935034 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-578f7852-03b0-4ad4-9be9-29216728cd43 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1548 microversion: 2.1 time: 0.174001 Aug 10 03:44:28.935685 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 479/943] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:28 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1548 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:28.952715 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9cca5f1d-715a-4932-aae8-99c9742e309f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:28.953414 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9cca5f1d-715a-4932-aae8-99c9742e309f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:28.959442 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9cca5f1d-715a-4932-aae8-99c9742e309f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:28.960087 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9cca5f1d-715a-4932-aae8-99c9742e309f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:28.961058 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9cca5f1d-715a-4932-aae8-99c9742e309f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:28.961488 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9cca5f1d-715a-4932-aae8-99c9742e309f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:29.089922 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-9cca5f1d-715a-4932-aae8-99c9742e309f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:29.097508 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9cca5f1d-715a-4932-aae8-99c9742e309f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1548 microversion: 2.1 time: 0.148493 Aug 10 03:44:29.097975 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 480/944] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:28 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:29.116859 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ce9943ad-1c13-4eff-a349-9ee76ea4cd1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:29.120229 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:44:29.120229 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:44:29.122115 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ce9943ad-1c13-4eff-a349-9ee76ea4cd1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:29.122866 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ce9943ad-1c13-4eff-a349-9ee76ea4cd1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Searching by: {'deleted': False, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e'} {{(pid=108439) get_all /opt/stack/nova/nova/compute/api.py:2833}} Aug 10 03:44:29.129707 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce9943ad-1c13-4eff-a349-9ee76ea4cd1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:29.130146 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce9943ad-1c13-4eff-a349-9ee76ea4cd1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:29.130928 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce9943ad-1c13-4eff-a349-9ee76ea4cd1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:29.131561 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce9943ad-1c13-4eff-a349-9ee76ea4cd1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:29.221045 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.multi_cell_list [None req-ce9943ad-1c13-4eff-a349-9ee76ea4cd1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 10 03:44:29.282415 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Flavor limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:44:29.282834 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Image limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:44:29.283297 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Flavor pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:44:29.283880 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Image pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:44:29.284336 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:44:29.298363 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:29.298363 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:29.298363 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:29.298363 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:29.312873 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Getting quotas for project db9e9e54834e4fe682d4305010655be7. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:44:29.316843 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Getting quotas for user e2a2db05b54e45fba8475e7949a61d6a and project db9e9e54834e4fe682d4305010655be7. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:44:29.317327 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ce9943ad-1c13-4eff-a349-9ee76ea4cd1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.204469 Aug 10 03:44:29.317925 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 481/945] 10.222.0.21 () {58 vars in 1125 bytes} [Tue Aug 10 03:44:29 2021] GET /compute/v2.1/servers => generated 342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:44:29.327780 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b2668e4c-9efd-4be1-9ea8-3f2605b82524 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:29.328431 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b2668e4c-9efd-4be1-9ea8-3f2605b82524 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:29.329462 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Going to run 1 instances... {{(pid=108440) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:44:29.331758 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:44:29.334134 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b2668e4c-9efd-4be1-9ea8-3f2605b82524 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:29.334582 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b2668e4c-9efd-4be1-9ea8-3f2605b82524 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:29.337633 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b2668e4c-9efd-4be1-9ea8-3f2605b82524 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:29.337633 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b2668e4c-9efd-4be1-9ea8-3f2605b82524 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:29.438816 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-dcc70a58-8197-4a4e-8b29-85c7d9d51ca6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.772903 Aug 10 03:44:29.439734 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 465/946] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:44:28 2021] POST /compute/v2.1/servers => generated 402 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 03:44:29.449032 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-cb30e9af-9cd9-4b56-89e7-e2dfe16b9eab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:29.449951 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-cb30e9af-9cd9-4b56-89e7-e2dfe16b9eab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:29.461807 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb30e9af-9cd9-4b56-89e7-e2dfe16b9eab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:29.462403 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb30e9af-9cd9-4b56-89e7-e2dfe16b9eab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:29.463579 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb30e9af-9cd9-4b56-89e7-e2dfe16b9eab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:29.464653 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb30e9af-9cd9-4b56-89e7-e2dfe16b9eab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:29.472275 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b2668e4c-9efd-4be1-9ea8-3f2605b82524 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:29.481441 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-cb30e9af-9cd9-4b56-89e7-e2dfe16b9eab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] HTTP exception thrown: Instance 0c599984-f271-4886-be2f-73e7531f52e4 could not be found. Aug 10 03:44:29.482038 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-cb30e9af-9cd9-4b56-89e7-e2dfe16b9eab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Returning 404 to user: Instance 0c599984-f271-4886-be2f-73e7531f52e4 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:44:29.482845 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b2668e4c-9efd-4be1-9ea8-3f2605b82524 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1548 microversion: 2.1 time: 0.158708 Aug 10 03:44:29.483230 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-cb30e9af-9cd9-4b56-89e7-e2dfe16b9eab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 404 len: 111 microversion: 2.20 time: 0.041786 Aug 10 03:44:29.483654 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 466/947] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:29 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 03:44:29.488423 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e87321ca-3188-4593-8845-dbe059280a0a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:29.488635 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 482/948] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:29 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:29.489390 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e87321ca-3188-4593-8845-dbe059280a0a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:29.493219 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-09097fe9-7b84-48ff-82c8-b95b508588ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '.version_select at 0x7f97a006e670>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:29.558522 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e87321ca-3188-4593-8845-dbe059280a0a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:29.565422 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e87321ca-3188-4593-8845-dbe059280a0a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1236 microversion: 2.1 time: 0.080518 Aug 10 03:44:29.565989 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 467/949] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:29 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:29.730705 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-09097fe9-7b84-48ff-82c8-b95b508588ad tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970662002" status: 204 len: 0 microversion: 2.20 time: 0.240436 Aug 10 03:44:29.730705 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 483/950] 10.222.0.21 () {60 vars in 1262 bytes} [Tue Aug 10 03:44:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970662002 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 03:44:30.582247 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f72d1291-e063-4184-8175-e46e88716b51 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:30.582866 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f72d1291-e063-4184-8175-e46e88716b51 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:30.589485 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f72d1291-e063-4184-8175-e46e88716b51 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:30.589980 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f72d1291-e063-4184-8175-e46e88716b51 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:30.590756 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f72d1291-e063-4184-8175-e46e88716b51 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:30.591191 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f72d1291-e063-4184-8175-e46e88716b51 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:30.638104 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ae21d80f-6707-4f6a-917f-8f179462d4af tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'create', calling method: .version_select at 0x7f97a0061160>, body: {"keypair": {"name": "tempest-keypair-76363245"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:30.658937 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f72d1291-e063-4184-8175-e46e88716b51 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:30.660319 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-ae21d80f-6707-4f6a-917f-8f179462d4af tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Getting quotas for project 098d020e6c2a497a939e7c54eb5cc81a. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:44:30.664556 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-ae21d80f-6707-4f6a-917f-8f179462d4af tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Getting quotas for user 84e7b0c8858f4616ad809fb025ffa9ff and project 098d020e6c2a497a939e7c54eb5cc81a. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:44:30.672773 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f72d1291-e063-4184-8175-e46e88716b51 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1240 microversion: 2.1 time: 0.094008 Aug 10 03:44:30.674283 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 468/951] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:30 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:30.927435 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-ae21d80f-6707-4f6a-917f-8f179462d4af tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Getting quotas for project 098d020e6c2a497a939e7c54eb5cc81a. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:44:30.929248 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-ae21d80f-6707-4f6a-917f-8f179462d4af tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Getting quotas for user 84e7b0c8858f4616ad809fb025ffa9ff and project 098d020e6c2a497a939e7c54eb5cc81a. Resources: {'key_pairs'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:44:30.942132 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ae21d80f-6707-4f6a-917f-8f179462d4af tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2314 microversion: 2.20 time: 0.307994 Aug 10 03:44:30.942723 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 484/952] 10.222.0.21 () {62 vars in 1199 bytes} [Tue Aug 10 03:44:30 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 309 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 10 03:44:31.689875 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-304adb5e-a6a9-4c9f-a886-aba8e8c55f42 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:31.690496 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-304adb5e-a6a9-4c9f-a886-aba8e8c55f42 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:31.696844 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-304adb5e-a6a9-4c9f-a886-aba8e8c55f42 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:31.697303 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-304adb5e-a6a9-4c9f-a886-aba8e8c55f42 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:31.698111 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-304adb5e-a6a9-4c9f-a886-aba8e8c55f42 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:31.698553 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-304adb5e-a6a9-4c9f-a886-aba8e8c55f42 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:31.764060 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-304adb5e-a6a9-4c9f-a886-aba8e8c55f42 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:31.771488 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-304adb5e-a6a9-4c9f-a886-aba8e8c55f42 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1240 microversion: 2.1 time: 0.085168 Aug 10 03:44:31.773343 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 469/953] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:31 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:32.750461 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1c5b75e3-5fd5-4ca2-ab3c-e0815d40356e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c92d1c1-baa7-4e18-beca-220c33918bdd"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:32.751505 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1c5b75e3-5fd5-4ca2-ab3c-e0815d40356e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:32.757705 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1c5b75e3-5fd5-4ca2-ab3c-e0815d40356e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:32.758478 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1c5b75e3-5fd5-4ca2-ab3c-e0815d40356e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:32.759264 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1c5b75e3-5fd5-4ca2-ab3c-e0815d40356e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:32.759695 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1c5b75e3-5fd5-4ca2-ab3c-e0815d40356e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:32.788300 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7c0f4e55-884d-45f2-9de2-d82be4748a06 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:32.789009 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7c0f4e55-884d-45f2-9de2-d82be4748a06 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:32.795368 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c0f4e55-884d-45f2-9de2-d82be4748a06 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:32.795893 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c0f4e55-884d-45f2-9de2-d82be4748a06 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:32.796777 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c0f4e55-884d-45f2-9de2-d82be4748a06 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:32.797424 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c0f4e55-884d-45f2-9de2-d82be4748a06 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:32.878942 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7c0f4e55-884d-45f2-9de2-d82be4748a06 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:32.887239 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7c0f4e55-884d-45f2-9de2-d82be4748a06 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1288 microversion: 2.1 time: 0.102633 Aug 10 03:44:32.887811 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 470/954] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:32 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1288 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:33.526643 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1236773278", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8a7c5b76-4670-410e-b09e-14552ce18301"}], "security_groups": [{"name": "tempest-securitygroup--50545919"}], "key_name": "tempest-keypair-76363245", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:33.660386 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.network.neutron [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] validate_networks() for [('8a7c5b76-4670-410e-b09e-14552ce18301', None, None, None)] {{(pid=108440) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:44:34.175623 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Flavor limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:44:34.176231 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Image limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:44:34.176623 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Flavor pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:44:34.177962 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Image pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:44:34.177962 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:44:34.178831 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1c5b75e3-5fd5-4ca2-ab3c-e0815d40356e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "POST /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.431855 Aug 10 03:44:34.181517 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 485/955] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 10 03:44:32 2021] POST /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/os-volume_attachments => generated 194 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:44:34.188884 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-474e1b0b-ed85-423d-a692-fcdbc06a5357 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:34.190882 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-474e1b0b-ed85-423d-a692-fcdbc06a5357 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:34.194594 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:34.197395 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:34.199083 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:34.199719 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:34.201734 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-474e1b0b-ed85-423d-a692-fcdbc06a5357 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:34.202334 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-474e1b0b-ed85-423d-a692-fcdbc06a5357 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:34.203456 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-474e1b0b-ed85-423d-a692-fcdbc06a5357 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:34.203988 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-474e1b0b-ed85-423d-a692-fcdbc06a5357 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:34.223464 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Getting quotas for project 098d020e6c2a497a939e7c54eb5cc81a. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:44:34.228543 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Getting quotas for user 84e7b0c8858f4616ad809fb025ffa9ff and project 098d020e6c2a497a939e7c54eb5cc81a. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:44:34.242435 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Going to run 1 instances... {{(pid=108440) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:44:34.245471 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:44:34.273381 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-474e1b0b-ed85-423d-a692-fcdbc06a5357 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:34.282138 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-474e1b0b-ed85-423d-a692-fcdbc06a5357 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1294 microversion: 2.1 time: 0.099438 Aug 10 03:44:34.282699 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 486/956] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:34 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1294 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:34.381262 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-bf7a6571-38a5-4275-95b9-3bedd9761456 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.859081 Aug 10 03:44:34.382020 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 471/957] 10.222.0.21 () {62 vars in 1188 bytes} [Tue Aug 10 03:44:33 2021] POST /compute/v2.1/servers => generated 400 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 10 03:44:34.392428 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-47022485-b2dc-478e-b0cb-37d1dd175780 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:34.393247 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-47022485-b2dc-478e-b0cb-37d1dd175780 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:34.450779 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-47022485-b2dc-478e-b0cb-37d1dd175780 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:34.460372 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-47022485-b2dc-478e-b0cb-37d1dd175780 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:34.462166 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-47022485-b2dc-478e-b0cb-37d1dd175780 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:34.463247 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-47022485-b2dc-478e-b0cb-37d1dd175780 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1280 microversion: 2.20 time: 0.074498 Aug 10 03:44:34.464011 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 487/958] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:34 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:44:35.299316 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-692a0af1-6683-4435-960f-6bf2f9b7d90e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:35.299961 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-692a0af1-6683-4435-960f-6bf2f9b7d90e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:35.305930 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-692a0af1-6683-4435-960f-6bf2f9b7d90e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:35.306457 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-692a0af1-6683-4435-960f-6bf2f9b7d90e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:35.307234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-692a0af1-6683-4435-960f-6bf2f9b7d90e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:35.307752 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-692a0af1-6683-4435-960f-6bf2f9b7d90e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:35.429132 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-692a0af1-6683-4435-960f-6bf2f9b7d90e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:35.436474 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-692a0af1-6683-4435-960f-6bf2f9b7d90e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1362 microversion: 2.1 time: 0.140756 Aug 10 03:44:35.437034 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 472/959] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:35 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1362 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:35.482401 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-94b9df0a-ab07-4f2e-91f1-fcf698a105a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:35.483286 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-94b9df0a-ab07-4f2e-91f1-fcf698a105a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:35.489092 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94b9df0a-ab07-4f2e-91f1-fcf698a105a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:35.489535 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94b9df0a-ab07-4f2e-91f1-fcf698a105a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:35.490300 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94b9df0a-ab07-4f2e-91f1-fcf698a105a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:35.490733 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94b9df0a-ab07-4f2e-91f1-fcf698a105a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:35.550132 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-94b9df0a-ab07-4f2e-91f1-fcf698a105a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:35.558280 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-94b9df0a-ab07-4f2e-91f1-fcf698a105a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:35.560081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-94b9df0a-ab07-4f2e-91f1-fcf698a105a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:35.561174 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-94b9df0a-ab07-4f2e-91f1-fcf698a105a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1284 microversion: 2.20 time: 0.083046 Aug 10 03:44:35.561745 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 488/960] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:35 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1284 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:36.454061 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-efd1013d-e94c-4382-8e5f-6413ecfbb2fe tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:36.454701 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-efd1013d-e94c-4382-8e5f-6413ecfbb2fe tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:36.460760 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-efd1013d-e94c-4382-8e5f-6413ecfbb2fe tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:36.461228 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-efd1013d-e94c-4382-8e5f-6413ecfbb2fe tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:36.461976 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-efd1013d-e94c-4382-8e5f-6413ecfbb2fe tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:36.462405 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-efd1013d-e94c-4382-8e5f-6413ecfbb2fe tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:36.578848 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-cf769535-3a66-4a6a-b5f0-b7d0664bd1b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:36.579396 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-cf769535-3a66-4a6a-b5f0-b7d0664bd1b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:36.585204 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-efd1013d-e94c-4382-8e5f-6413ecfbb2fe tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:36.585956 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cf769535-3a66-4a6a-b5f0-b7d0664bd1b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:36.586411 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cf769535-3a66-4a6a-b5f0-b7d0664bd1b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:36.587196 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cf769535-3a66-4a6a-b5f0-b7d0664bd1b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:36.587629 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cf769535-3a66-4a6a-b5f0-b7d0664bd1b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:36.592562 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-efd1013d-e94c-4382-8e5f-6413ecfbb2fe tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1362 microversion: 2.1 time: 0.142077 Aug 10 03:44:36.593319 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 473/961] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:36 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1362 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:36.647698 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-cf769535-3a66-4a6a-b5f0-b7d0664bd1b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:36.655841 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-cf769535-3a66-4a6a-b5f0-b7d0664bd1b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:36.657439 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-cf769535-3a66-4a6a-b5f0-b7d0664bd1b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:36.658618 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-cf769535-3a66-4a6a-b5f0-b7d0664bd1b0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1284 microversion: 2.20 time: 0.083646 Aug 10 03:44:36.659242 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 489/962] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:36 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:44:37.610396 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-cb8ad4f5-ae05-4744-b378-064d05d127bb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:37.610996 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-cb8ad4f5-ae05-4744-b378-064d05d127bb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:37.616772 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb8ad4f5-ae05-4744-b378-064d05d127bb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:37.617219 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb8ad4f5-ae05-4744-b378-064d05d127bb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:37.617995 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb8ad4f5-ae05-4744-b378-064d05d127bb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:37.618424 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb8ad4f5-ae05-4744-b378-064d05d127bb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:37.821857 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-cb8ad4f5-ae05-4744-b378-064d05d127bb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:37.831375 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-cb8ad4f5-ae05-4744-b378-064d05d127bb tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1362 microversion: 2.1 time: 0.224842 Aug 10 03:44:37.832670 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 474/963] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:37 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:37.846466 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ce55ee6f-4110-4ddc-b45e-9ac7b177d8cb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:37.850753 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ce55ee6f-4110-4ddc-b45e-9ac7b177d8cb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:37.858135 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-99dd8a73-ee46-49eb-8917-813f49eb9705 req-d6f11584-3d25-4143-914b-e8818ec8543c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39489822-b8f1-4176-a07f-4b84b1cd3d67", "tag": "1fd204ba-f590-4c87-bff7-78c11eab8e44"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:37.866457 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:44:37.866457 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:44:37.872134 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ce55ee6f-4110-4ddc-b45e-9ac7b177d8cb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:37.873084 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ce55ee6f-4110-4ddc-b45e-9ac7b177d8cb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:37.874488 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ce55ee6f-4110-4ddc-b45e-9ac7b177d8cb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:37.875608 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ce55ee6f-4110-4ddc-b45e-9ac7b177d8cb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:37.883164 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-99dd8a73-ee46-49eb-8917-813f49eb9705 req-d6f11584-3d25-4143-914b-e8818ec8543c service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:37.883881 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-99dd8a73-ee46-49eb-8917-813f49eb9705 req-d6f11584-3d25-4143-914b-e8818ec8543c service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:37.909849 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-99dd8a73-ee46-49eb-8917-813f49eb9705 req-d6f11584-3d25-4143-914b-e8818ec8543c service nova] Creating event network-changed:1fd204ba-f590-4c87-bff7-78c11eab8e44 for instance 39489822-b8f1-4176-a07f-4b84b1cd3d67 on hv-cinder-78239 Aug 10 03:44:37.917862 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-99dd8a73-ee46-49eb-8917-813f49eb9705 req-d6f11584-3d25-4143-914b-e8818ec8543c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.262975 Aug 10 03:44:37.918899 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 490/964] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:44:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:44:37.925763 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1905249429", "imageRef": "e4eee002-b966-4ad5-9277-7bdced8b558b", "flavorRef": "452", "networks": [{"uuid": "cc5377b0-3199-4b12-99e9-e00114dd096c"}]}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:37.966445 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ce55ee6f-4110-4ddc-b45e-9ac7b177d8cb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:37.980953 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ce55ee6f-4110-4ddc-b45e-9ac7b177d8cb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:37.993866 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ce55ee6f-4110-4ddc-b45e-9ac7b177d8cb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:37.994369 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.network.neutron [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] validate_networks() for [('cc5377b0-3199-4b12-99e9-e00114dd096c', None, None, None)] {{(pid=108439) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:44:37.994745 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ce55ee6f-4110-4ddc-b45e-9ac7b177d8cb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1332 microversion: 2.20 time: 0.160970 Aug 10 03:44:37.995847 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 475/965] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:37 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1332 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:38.473886 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Flavor limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:44:38.474424 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Image limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:44:38.478120 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Flavor pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:44:38.478939 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Image pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:44:38.480276 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:44:38.494257 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:38.495083 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:38.496066 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:38.496826 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:38.521964 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Getting quotas for project 2ce125c05e8d4cb99302437ab92ffd2c. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:44:38.527458 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Getting quotas for user f2206fc1fcde4dc4bc9dd24c016c2dbf and project 2ce125c05e8d4cb99302437ab92ffd2c. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:44:38.554230 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Going to run 1 instances... {{(pid=108439) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:44:38.554230 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4eee002-b966-4ad5-9277-7bdced8b558b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:44:38.747463 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2de25c49-6f35-4515-803d-067729b68d17 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826822 Aug 10 03:44:38.748031 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 491/966] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:44:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 03:44:38.757868 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e768d588-19fc-48db-b54f-ff2ac9f44312 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:38.758484 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e768d588-19fc-48db-b54f-ff2ac9f44312 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:38.816389 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e768d588-19fc-48db-b54f-ff2ac9f44312 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:38.822527 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e768d588-19fc-48db-b54f-ff2ac9f44312 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1219 microversion: 2.1 time: 0.068221 Aug 10 03:44:38.831879 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 476/967] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:38 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:38.850577 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-519366d2-27f3-4244-92fd-c034221fc5dd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:38.851199 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-519366d2-27f3-4244-92fd-c034221fc5dd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:38.860997 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-519366d2-27f3-4244-92fd-c034221fc5dd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:38.861694 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-519366d2-27f3-4244-92fd-c034221fc5dd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:38.862246 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-519366d2-27f3-4244-92fd-c034221fc5dd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:38.862678 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-519366d2-27f3-4244-92fd-c034221fc5dd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:39.016869 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-778169d8-7073-4f29-858a-b7d1ef05ccd7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:39.018152 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-778169d8-7073-4f29-858a-b7d1ef05ccd7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:39.024082 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-778169d8-7073-4f29-858a-b7d1ef05ccd7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:39.024578 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-778169d8-7073-4f29-858a-b7d1ef05ccd7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:39.027360 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-778169d8-7073-4f29-858a-b7d1ef05ccd7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:39.027360 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-778169d8-7073-4f29-858a-b7d1ef05ccd7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:39.029426 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-519366d2-27f3-4244-92fd-c034221fc5dd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:39.041494 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-519366d2-27f3-4244-92fd-c034221fc5dd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1362 microversion: 2.1 time: 0.193876 Aug 10 03:44:39.042411 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 492/968] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:38 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:39.105416 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-778169d8-7073-4f29-858a-b7d1ef05ccd7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:39.114498 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-778169d8-7073-4f29-858a-b7d1ef05ccd7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:39.116063 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-778169d8-7073-4f29-858a-b7d1ef05ccd7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:39.117301 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-778169d8-7073-4f29-858a-b7d1ef05ccd7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1338 microversion: 2.20 time: 0.104270 Aug 10 03:44:39.117932 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 477/969] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:39 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:44:39.839376 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-843e00f6-4a83-4d3c-ad11-7c63cb07ba88 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:39.840451 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-843e00f6-4a83-4d3c-ad11-7c63cb07ba88 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:39.847400 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-843e00f6-4a83-4d3c-ad11-7c63cb07ba88 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:39.847837 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-843e00f6-4a83-4d3c-ad11-7c63cb07ba88 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:39.848808 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-843e00f6-4a83-4d3c-ad11-7c63cb07ba88 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:39.849281 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-843e00f6-4a83-4d3c-ad11-7c63cb07ba88 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:39.917605 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-843e00f6-4a83-4d3c-ad11-7c63cb07ba88 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:39.925432 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-843e00f6-4a83-4d3c-ad11-7c63cb07ba88 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1223 microversion: 2.1 time: 0.090085 Aug 10 03:44:39.925954 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 493/970] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:39 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:40.133124 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f043fe00-531c-4c71-95e7-b316dd565e37 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:40.133738 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f043fe00-531c-4c71-95e7-b316dd565e37 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:40.136181 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-db93b966-a15b-45c0-b79d-01c41ae6203e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:40.137024 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-db93b966-a15b-45c0-b79d-01c41ae6203e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:40.141145 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f043fe00-531c-4c71-95e7-b316dd565e37 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:40.141711 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f043fe00-531c-4c71-95e7-b316dd565e37 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:40.142491 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f043fe00-531c-4c71-95e7-b316dd565e37 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:40.143165 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f043fe00-531c-4c71-95e7-b316dd565e37 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:40.154816 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-db93b966-a15b-45c0-b79d-01c41ae6203e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:40.154816 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-db93b966-a15b-45c0-b79d-01c41ae6203e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:40.154816 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-db93b966-a15b-45c0-b79d-01c41ae6203e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:40.154816 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-db93b966-a15b-45c0-b79d-01c41ae6203e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:40.283217 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f043fe00-531c-4c71-95e7-b316dd565e37 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:40.295974 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f043fe00-531c-4c71-95e7-b316dd565e37 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1362 microversion: 2.1 time: 0.239143 Aug 10 03:44:40.298210 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 478/971] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:40 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:40.304436 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-db93b966-a15b-45c0-b79d-01c41ae6203e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:40.313946 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-db93b966-a15b-45c0-b79d-01c41ae6203e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:40.315430 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-db93b966-a15b-45c0-b79d-01c41ae6203e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:40.316603 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-db93b966-a15b-45c0-b79d-01c41ae6203e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1404 microversion: 2.20 time: 0.185039 Aug 10 03:44:40.317153 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 494/972] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:40 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1404 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:40.674315 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-d0d65214-f1cf-4361-8686-18197384f48a req-137c6b5c-362a-4aca-ad76-f89969750b16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c37790e-ad20-4784-b0f0-20babcf19223", "tag": "638e6702-b0f3-46b1-b6c2-197d8b06363d"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:40.681577 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:44:40.681577 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:44:40.688667 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-d0d65214-f1cf-4361-8686-18197384f48a req-137c6b5c-362a-4aca-ad76-f89969750b16 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:40.689107 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-d0d65214-f1cf-4361-8686-18197384f48a req-137c6b5c-362a-4aca-ad76-f89969750b16 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:40.704702 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-d0d65214-f1cf-4361-8686-18197384f48a req-137c6b5c-362a-4aca-ad76-f89969750b16 service nova] Creating event network-changed:638e6702-b0f3-46b1-b6c2-197d8b06363d for instance 5c37790e-ad20-4784-b0f0-20babcf19223 on hv-cinder-78239 Aug 10 03:44:40.709909 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-d0d65214-f1cf-4361-8686-18197384f48a req-137c6b5c-362a-4aca-ad76-f89969750b16 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040472 Aug 10 03:44:40.710507 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 479/973] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:44:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:44:40.948899 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5930d931-8772-43d8-9d33-00c071806d80 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:40.948899 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-5930d931-8772-43d8-9d33-00c071806d80 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:40.950903 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5930d931-8772-43d8-9d33-00c071806d80 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:40.951350 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5930d931-8772-43d8-9d33-00c071806d80 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:40.952324 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5930d931-8772-43d8-9d33-00c071806d80 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:40.952920 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5930d931-8772-43d8-9d33-00c071806d80 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:41.022827 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-5930d931-8772-43d8-9d33-00c071806d80 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:41.031431 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5930d931-8772-43d8-9d33-00c071806d80 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1271 microversion: 2.1 time: 0.092429 Aug 10 03:44:41.032004 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 495/974] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:40 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:41.314764 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c2a6e872-6f6d-4189-9cce-93ebaff5b571 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:41.315489 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c2a6e872-6f6d-4189-9cce-93ebaff5b571 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:41.322814 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c2a6e872-6f6d-4189-9cce-93ebaff5b571 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:41.323173 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c2a6e872-6f6d-4189-9cce-93ebaff5b571 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:41.324737 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c2a6e872-6f6d-4189-9cce-93ebaff5b571 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:41.325170 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c2a6e872-6f6d-4189-9cce-93ebaff5b571 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:41.335109 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-580ac399-9307-461d-abd0-b2bbbcbf4a91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:41.335754 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-580ac399-9307-461d-abd0-b2bbbcbf4a91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:41.343307 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-580ac399-9307-461d-abd0-b2bbbcbf4a91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:41.343752 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-580ac399-9307-461d-abd0-b2bbbcbf4a91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:41.344559 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-580ac399-9307-461d-abd0-b2bbbcbf4a91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:41.344990 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-580ac399-9307-461d-abd0-b2bbbcbf4a91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:41.477239 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-580ac399-9307-461d-abd0-b2bbbcbf4a91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:41.487957 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-580ac399-9307-461d-abd0-b2bbbcbf4a91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:41.489590 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-580ac399-9307-461d-abd0-b2bbbcbf4a91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:41.490860 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-580ac399-9307-461d-abd0-b2bbbcbf4a91 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1404 microversion: 2.20 time: 0.159436 Aug 10 03:44:41.509115 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 496/975] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:41 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1404 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:44:41.907938 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c2a6e872-6f6d-4189-9cce-93ebaff5b571 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:41.918065 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c2a6e872-6f6d-4189-9cce-93ebaff5b571 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1362 microversion: 2.1 time: 0.607297 Aug 10 03:44:41.918634 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 480/976] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:41 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1362 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:42.048190 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5462cc6d-e801-4fe8-b4b9-c282b240de99 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:42.049002 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-5462cc6d-e801-4fe8-b4b9-c282b240de99 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:42.055343 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5462cc6d-e801-4fe8-b4b9-c282b240de99 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:42.055911 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5462cc6d-e801-4fe8-b4b9-c282b240de99 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:42.056505 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5462cc6d-e801-4fe8-b4b9-c282b240de99 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:42.056941 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5462cc6d-e801-4fe8-b4b9-c282b240de99 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:42.120939 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-5462cc6d-e801-4fe8-b4b9-c282b240de99 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:42.128291 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5462cc6d-e801-4fe8-b4b9-c282b240de99 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1277 microversion: 2.1 time: 0.083749 Aug 10 03:44:42.128865 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 497/977] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:42 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:42.511540 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-30206769-94b6-4ed2-a240-5a4429378070 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:42.512371 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-30206769-94b6-4ed2-a240-5a4429378070 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:42.519049 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-30206769-94b6-4ed2-a240-5a4429378070 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:42.519747 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-30206769-94b6-4ed2-a240-5a4429378070 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:42.520731 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-30206769-94b6-4ed2-a240-5a4429378070 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:42.521348 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-30206769-94b6-4ed2-a240-5a4429378070 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:42.751802 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-30206769-94b6-4ed2-a240-5a4429378070 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:42.759886 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-30206769-94b6-4ed2-a240-5a4429378070 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:42.762021 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-30206769-94b6-4ed2-a240-5a4429378070 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:42.763265 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-30206769-94b6-4ed2-a240-5a4429378070 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1404 microversion: 2.20 time: 0.256951 Aug 10 03:44:42.763933 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 481/978] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:42 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1404 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:42.936223 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a6aaf5f9-32f8-4586-94b4-01808d6e647e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:42.937675 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a6aaf5f9-32f8-4586-94b4-01808d6e647e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:42.950211 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a6aaf5f9-32f8-4586-94b4-01808d6e647e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:42.952615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a6aaf5f9-32f8-4586-94b4-01808d6e647e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:42.952615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a6aaf5f9-32f8-4586-94b4-01808d6e647e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:42.952615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a6aaf5f9-32f8-4586-94b4-01808d6e647e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:43.093226 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a6aaf5f9-32f8-4586-94b4-01808d6e647e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:43.100820 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a6aaf5f9-32f8-4586-94b4-01808d6e647e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1362 microversion: 2.1 time: 0.168773 Aug 10 03:44:43.101385 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 498/979] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:42 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:43.144960 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-dfc421e3-42c5-48af-bb92-89e5048a1574 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:43.145631 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-dfc421e3-42c5-48af-bb92-89e5048a1574 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:43.152346 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dfc421e3-42c5-48af-bb92-89e5048a1574 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:43.152782 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dfc421e3-42c5-48af-bb92-89e5048a1574 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:43.153655 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dfc421e3-42c5-48af-bb92-89e5048a1574 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:43.154030 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-dfc421e3-42c5-48af-bb92-89e5048a1574 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:43.433559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-dfc421e3-42c5-48af-bb92-89e5048a1574 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:43.444466 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-dfc421e3-42c5-48af-bb92-89e5048a1574 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1319 microversion: 2.1 time: 0.302984 Aug 10 03:44:43.445795 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 482/980] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:43 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:43.781471 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2c71ad7b-af4d-4f4c-af39-9d4ec0a50c14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:43.782203 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2c71ad7b-af4d-4f4c-af39-9d4ec0a50c14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:43.788110 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2c71ad7b-af4d-4f4c-af39-9d4ec0a50c14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:43.788559 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2c71ad7b-af4d-4f4c-af39-9d4ec0a50c14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:43.789391 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2c71ad7b-af4d-4f4c-af39-9d4ec0a50c14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:43.789906 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2c71ad7b-af4d-4f4c-af39-9d4ec0a50c14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:43.924889 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2c71ad7b-af4d-4f4c-af39-9d4ec0a50c14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:43.933244 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2c71ad7b-af4d-4f4c-af39-9d4ec0a50c14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:43.934868 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2c71ad7b-af4d-4f4c-af39-9d4ec0a50c14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:43.935938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2c71ad7b-af4d-4f4c-af39-9d4ec0a50c14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1404 microversion: 2.20 time: 0.158252 Aug 10 03:44:43.936523 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 499/981] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:43 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:44.112332 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-5f89cffe-9236-4284-ad3f-c576f1253c4e req-9c4ed22a-5163-4eb5-a284-2f5358c2fb5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab91771-2631-4430-adf0-a39b63cfc1de", "tag": "887ed7fa-0ce1-4a88-8da2-e406a0557f46"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:44.114080 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:44:44.114080 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:44:44.121552 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3669d100-84ce-42c8-8269-270a0a25bd57 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:44.122531 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-5f89cffe-9236-4284-ad3f-c576f1253c4e req-9c4ed22a-5163-4eb5-a284-2f5358c2fb5e service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:44.126509 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3669d100-84ce-42c8-8269-270a0a25bd57 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:44.126666 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-5f89cffe-9236-4284-ad3f-c576f1253c4e req-9c4ed22a-5163-4eb5-a284-2f5358c2fb5e service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:44.130440 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3669d100-84ce-42c8-8269-270a0a25bd57 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:44.130979 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3669d100-84ce-42c8-8269-270a0a25bd57 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:44.131830 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3669d100-84ce-42c8-8269-270a0a25bd57 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:44.132491 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3669d100-84ce-42c8-8269-270a0a25bd57 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:44.135766 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-5f89cffe-9236-4284-ad3f-c576f1253c4e req-9c4ed22a-5163-4eb5-a284-2f5358c2fb5e service nova] Creating event network-changed:887ed7fa-0ce1-4a88-8da2-e406a0557f46 for instance 6ab91771-2631-4430-adf0-a39b63cfc1de on hv-cinder-78239 Aug 10 03:44:44.140843 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-5f89cffe-9236-4284-ad3f-c576f1253c4e req-9c4ed22a-5163-4eb5-a284-2f5358c2fb5e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033180 Aug 10 03:44:44.141441 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 483/982] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:44:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:44:44.267576 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3669d100-84ce-42c8-8269-270a0a25bd57 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:44.275735 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3669d100-84ce-42c8-8269-270a0a25bd57 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1362 microversion: 2.1 time: 0.159743 Aug 10 03:44:44.276952 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 500/983] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:44 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:44.462289 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a47a5e87-82a2-4894-be08-a57a7c62eeea tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:44.463081 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a47a5e87-82a2-4894-be08-a57a7c62eeea tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:44.469599 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a47a5e87-82a2-4894-be08-a57a7c62eeea tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:44.470055 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a47a5e87-82a2-4894-be08-a57a7c62eeea tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:44.470825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a47a5e87-82a2-4894-be08-a57a7c62eeea tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:44.471256 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a47a5e87-82a2-4894-be08-a57a7c62eeea tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:44.734893 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a47a5e87-82a2-4894-be08-a57a7c62eeea tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:44.742230 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a47a5e87-82a2-4894-be08-a57a7c62eeea tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1319 microversion: 2.1 time: 0.284004 Aug 10 03:44:44.742935 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 484/984] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:44 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:44.954910 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-062a11de-a8d6-4877-b525-8b7ecc061865 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:44.955523 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-062a11de-a8d6-4877-b525-8b7ecc061865 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:44.962049 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-062a11de-a8d6-4877-b525-8b7ecc061865 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:44.964951 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-062a11de-a8d6-4877-b525-8b7ecc061865 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:44.964951 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-062a11de-a8d6-4877-b525-8b7ecc061865 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:44.965382 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-062a11de-a8d6-4877-b525-8b7ecc061865 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:45.147227 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-33e84ebe-a684-43f7-9194-5388aa44402e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:45.147834 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-33e84ebe-a684-43f7-9194-5388aa44402e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:45.152928 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-062a11de-a8d6-4877-b525-8b7ecc061865 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:45.157233 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-33e84ebe-a684-43f7-9194-5388aa44402e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:45.158075 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-33e84ebe-a684-43f7-9194-5388aa44402e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:45.159059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-33e84ebe-a684-43f7-9194-5388aa44402e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:45.159856 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-33e84ebe-a684-43f7-9194-5388aa44402e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:45.165341 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-062a11de-a8d6-4877-b525-8b7ecc061865 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:45.168478 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-062a11de-a8d6-4877-b525-8b7ecc061865 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:45.170536 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-062a11de-a8d6-4877-b525-8b7ecc061865 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1404 microversion: 2.20 time: 0.220258 Aug 10 03:44:45.172509 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 501/985] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:44 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:45.260923 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-0096868b-6a31-4465-8d8f-1d0a42a5ad2e req-7bd562b4-3a50-42fd-bdcb-2d4897c3edc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39489822-b8f1-4176-a07f-4b84b1cd3d67", "name": "network-vif-plugged", "status": "completed", "tag": "1fd204ba-f590-4c87-bff7-78c11eab8e44"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:45.263226 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:44:45.263226 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:44:45.271118 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-0096868b-6a31-4465-8d8f-1d0a42a5ad2e req-7bd562b4-3a50-42fd-bdcb-2d4897c3edc2 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:45.276968 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-0096868b-6a31-4465-8d8f-1d0a42a5ad2e req-7bd562b4-3a50-42fd-bdcb-2d4897c3edc2 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:45.285001 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-0096868b-6a31-4465-8d8f-1d0a42a5ad2e req-7bd562b4-3a50-42fd-bdcb-2d4897c3edc2 service nova] Creating event network-vif-plugged:1fd204ba-f590-4c87-bff7-78c11eab8e44 for instance 39489822-b8f1-4176-a07f-4b84b1cd3d67 on hv-cinder-78239 Aug 10 03:44:45.290747 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-0096868b-6a31-4465-8d8f-1d0a42a5ad2e req-7bd562b4-3a50-42fd-bdcb-2d4897c3edc2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034896 Aug 10 03:44:45.291684 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 502/986] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:44:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:44:45.294467 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-33e84ebe-a684-43f7-9194-5388aa44402e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:45.298242 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e6f9c44b-e08a-4e0e-8d25-ae1022b9e9b1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:45.299082 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e6f9c44b-e08a-4e0e-8d25-ae1022b9e9b1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:45.302008 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-33e84ebe-a684-43f7-9194-5388aa44402e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1594 microversion: 2.1 time: 0.158435 Aug 10 03:44:45.302570 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 485/987] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:45 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:45.306514 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e6f9c44b-e08a-4e0e-8d25-ae1022b9e9b1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:45.307149 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e6f9c44b-e08a-4e0e-8d25-ae1022b9e9b1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:45.308251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e6f9c44b-e08a-4e0e-8d25-ae1022b9e9b1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:45.308934 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e6f9c44b-e08a-4e0e-8d25-ae1022b9e9b1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:45.512134 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e6f9c44b-e08a-4e0e-8d25-ae1022b9e9b1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:45.521316 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e6f9c44b-e08a-4e0e-8d25-ae1022b9e9b1 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1362 microversion: 2.1 time: 0.227557 Aug 10 03:44:45.522026 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 503/988] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:45 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:45.760615 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f43fd522-2404-4919-b908-5bedde4fd1e5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:45.761825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f43fd522-2404-4919-b908-5bedde4fd1e5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:45.770633 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f43fd522-2404-4919-b908-5bedde4fd1e5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:45.771159 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f43fd522-2404-4919-b908-5bedde4fd1e5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:45.771997 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f43fd522-2404-4919-b908-5bedde4fd1e5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:45.772602 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f43fd522-2404-4919-b908-5bedde4fd1e5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:45.961769 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f43fd522-2404-4919-b908-5bedde4fd1e5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:45.969789 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f43fd522-2404-4919-b908-5bedde4fd1e5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1319 microversion: 2.1 time: 0.213663 Aug 10 03:44:45.970395 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 486/989] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:45 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:46.189297 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-16c8fa7d-d449-438b-932d-cf311ebc8ae9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:46.190010 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-16c8fa7d-d449-438b-932d-cf311ebc8ae9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:46.196429 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16c8fa7d-d449-438b-932d-cf311ebc8ae9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:46.196952 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16c8fa7d-d449-438b-932d-cf311ebc8ae9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:46.198017 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16c8fa7d-d449-438b-932d-cf311ebc8ae9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:46.198462 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-16c8fa7d-d449-438b-932d-cf311ebc8ae9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:46.333583 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-16c8fa7d-d449-438b-932d-cf311ebc8ae9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:46.342754 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-16c8fa7d-d449-438b-932d-cf311ebc8ae9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:46.344473 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-16c8fa7d-d449-438b-932d-cf311ebc8ae9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:46.345970 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-16c8fa7d-d449-438b-932d-cf311ebc8ae9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1404 microversion: 2.20 time: 0.160294 Aug 10 03:44:46.363972 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 504/990] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:46 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:46.538683 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-44d9fffc-8ff1-4529-b157-16db1f7dc68a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:46.539335 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-44d9fffc-8ff1-4529-b157-16db1f7dc68a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:46.555615 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44d9fffc-8ff1-4529-b157-16db1f7dc68a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:46.556542 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44d9fffc-8ff1-4529-b157-16db1f7dc68a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:46.558045 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44d9fffc-8ff1-4529-b157-16db1f7dc68a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:46.558789 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44d9fffc-8ff1-4529-b157-16db1f7dc68a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:46.794435 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-44d9fffc-8ff1-4529-b157-16db1f7dc68a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:46.802778 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-44d9fffc-8ff1-4529-b157-16db1f7dc68a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1362 microversion: 2.1 time: 0.267641 Aug 10 03:44:46.803665 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 487/991] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:46 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:46.987161 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2e865c1a-8123-4400-9fce-e31579bd147a tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:46.988022 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2e865c1a-8123-4400-9fce-e31579bd147a tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:46.994214 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2e865c1a-8123-4400-9fce-e31579bd147a tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:46.994938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2e865c1a-8123-4400-9fce-e31579bd147a tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:46.995908 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2e865c1a-8123-4400-9fce-e31579bd147a tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:46.996529 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2e865c1a-8123-4400-9fce-e31579bd147a tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:47.157797 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2e865c1a-8123-4400-9fce-e31579bd147a tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:47.165432 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2e865c1a-8123-4400-9fce-e31579bd147a tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1319 microversion: 2.1 time: 0.181847 Aug 10 03:44:47.166005 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 505/992] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:46 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:47.315815 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-f96838ef-7461-482d-8b47-8252e322a588 req-265d428f-7a98-4387-a4a2-e79c53145cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c37790e-ad20-4784-b0f0-20babcf19223", "name": "network-vif-plugged", "status": "completed", "tag": "638e6702-b0f3-46b1-b6c2-197d8b06363d"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:47.316512 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:44:47.316512 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:44:47.328240 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-f96838ef-7461-482d-8b47-8252e322a588 req-265d428f-7a98-4387-a4a2-e79c53145cfd service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:47.328934 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-f96838ef-7461-482d-8b47-8252e322a588 req-265d428f-7a98-4387-a4a2-e79c53145cfd service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:47.345799 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-f96838ef-7461-482d-8b47-8252e322a588 req-265d428f-7a98-4387-a4a2-e79c53145cfd service nova] Creating event network-vif-plugged:638e6702-b0f3-46b1-b6c2-197d8b06363d for instance 5c37790e-ad20-4784-b0f0-20babcf19223 on hv-cinder-78239 Aug 10 03:44:47.352755 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-f96838ef-7461-482d-8b47-8252e322a588 req-265d428f-7a98-4387-a4a2-e79c53145cfd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047435 Aug 10 03:44:47.354235 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 488/993] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:44:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:44:47.371885 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-890e8333-528c-4974-8574-145ad35cbce8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:47.374130 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-890e8333-528c-4974-8574-145ad35cbce8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:47.392485 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-890e8333-528c-4974-8574-145ad35cbce8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:47.393340 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-890e8333-528c-4974-8574-145ad35cbce8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:47.395074 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-890e8333-528c-4974-8574-145ad35cbce8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:47.406637 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-890e8333-528c-4974-8574-145ad35cbce8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:47.538332 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-890e8333-528c-4974-8574-145ad35cbce8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:47.556215 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-890e8333-528c-4974-8574-145ad35cbce8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:47.558207 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-890e8333-528c-4974-8574-145ad35cbce8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:47.559301 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-890e8333-528c-4974-8574-145ad35cbce8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1404 microversion: 2.20 time: 0.197378 Aug 10 03:44:47.559860 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 506/994] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:47 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1404 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:47.821855 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-490d105e-d2a5-4760-8ffd-afa8a123d564 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:47.822552 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-490d105e-d2a5-4760-8ffd-afa8a123d564 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:47.829204 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-490d105e-d2a5-4760-8ffd-afa8a123d564 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:47.829647 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-490d105e-d2a5-4760-8ffd-afa8a123d564 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:47.830545 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-490d105e-d2a5-4760-8ffd-afa8a123d564 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:47.831208 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-490d105e-d2a5-4760-8ffd-afa8a123d564 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:48.182340 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-dbd3f858-0cca-44de-be5c-67dd977aa584 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:48.182964 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-dbd3f858-0cca-44de-be5c-67dd977aa584 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:48.188664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dbd3f858-0cca-44de-be5c-67dd977aa584 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:48.189104 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dbd3f858-0cca-44de-be5c-67dd977aa584 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:48.189901 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dbd3f858-0cca-44de-be5c-67dd977aa584 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:48.190330 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dbd3f858-0cca-44de-be5c-67dd977aa584 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:48.231776 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-490d105e-d2a5-4760-8ffd-afa8a123d564 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:48.247922 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-490d105e-d2a5-4760-8ffd-afa8a123d564 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1547 microversion: 2.1 time: 0.429323 Aug 10 03:44:48.251370 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 489/995] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:47 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1547 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:48.267478 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7967f0ce-5abf-4ec4-ad9d-dc44d6a722e9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:48.268468 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7967f0ce-5abf-4ec4-ad9d-dc44d6a722e9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:48.275112 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7967f0ce-5abf-4ec4-ad9d-dc44d6a722e9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:48.275770 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7967f0ce-5abf-4ec4-ad9d-dc44d6a722e9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:48.277244 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7967f0ce-5abf-4ec4-ad9d-dc44d6a722e9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:48.277941 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7967f0ce-5abf-4ec4-ad9d-dc44d6a722e9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:48.361784 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-dbd3f858-0cca-44de-be5c-67dd977aa584 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:48.369375 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-dbd3f858-0cca-44de-be5c-67dd977aa584 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1319 microversion: 2.1 time: 0.190610 Aug 10 03:44:48.370224 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 507/996] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:48 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:48.389407 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7967f0ce-5abf-4ec4-ad9d-dc44d6a722e9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125948 Aug 10 03:44:48.392157 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 490/997] 10.222.0.21 () {58 vars in 1275 bytes} [Tue Aug 10 03:44:48 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:44:48.577396 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3341513e-2494-4c5d-8d71-7f4ff7d2354e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:48.577979 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3341513e-2494-4c5d-8d71-7f4ff7d2354e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:48.593879 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3341513e-2494-4c5d-8d71-7f4ff7d2354e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:48.594333 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3341513e-2494-4c5d-8d71-7f4ff7d2354e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:48.595117 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3341513e-2494-4c5d-8d71-7f4ff7d2354e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:48.595547 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3341513e-2494-4c5d-8d71-7f4ff7d2354e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:48.692788 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-6a810deb-11b5-417c-a031-eaebf0fe773c req-85504ca6-415f-48a3-bcd6-32e5f91e4165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2969b784-ae47-4dce-a4d1-f86c2d508de8", "tag": "e4c32421-6086-4a06-97cd-96e3d3edc391"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:48.694723 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:44:48.694723 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:44:48.702657 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-6a810deb-11b5-417c-a031-eaebf0fe773c req-85504ca6-415f-48a3-bcd6-32e5f91e4165 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:48.703091 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-6a810deb-11b5-417c-a031-eaebf0fe773c req-85504ca6-415f-48a3-bcd6-32e5f91e4165 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:48.732565 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-6a810deb-11b5-417c-a031-eaebf0fe773c req-85504ca6-415f-48a3-bcd6-32e5f91e4165 service nova] Creating event network-changed:e4c32421-6086-4a06-97cd-96e3d3edc391 for instance 2969b784-ae47-4dce-a4d1-f86c2d508de8 on hv-cinder-78239 Aug 10 03:44:48.743343 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-6a810deb-11b5-417c-a031-eaebf0fe773c req-85504ca6-415f-48a3-bcd6-32e5f91e4165 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053331 Aug 10 03:44:48.745968 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 491/998] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:44:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:44:48.862786 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3341513e-2494-4c5d-8d71-7f4ff7d2354e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:48.875424 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3341513e-2494-4c5d-8d71-7f4ff7d2354e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:48.878307 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3341513e-2494-4c5d-8d71-7f4ff7d2354e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:48.880083 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3341513e-2494-4c5d-8d71-7f4ff7d2354e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1404 microversion: 2.20 time: 0.306253 Aug 10 03:44:48.881236 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 508/999] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:48 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1404 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:49.387573 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b4fcc02e-68af-485c-9aab-da7e5770194b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:49.388403 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b4fcc02e-68af-485c-9aab-da7e5770194b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:49.398682 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b4fcc02e-68af-485c-9aab-da7e5770194b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:49.400326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b4fcc02e-68af-485c-9aab-da7e5770194b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:49.401583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b4fcc02e-68af-485c-9aab-da7e5770194b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:49.403907 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b4fcc02e-68af-485c-9aab-da7e5770194b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:49.811604 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b4fcc02e-68af-485c-9aab-da7e5770194b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:49.819519 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b4fcc02e-68af-485c-9aab-da7e5770194b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1319 microversion: 2.1 time: 0.436955 Aug 10 03:44:49.830247 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 492/1000] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:49 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:49.900058 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-36777e34-6dae-4f47-b984-ede20ae340a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:49.900752 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-36777e34-6dae-4f47-b984-ede20ae340a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:49.912276 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36777e34-6dae-4f47-b984-ede20ae340a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:49.912732 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36777e34-6dae-4f47-b984-ede20ae340a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:49.913532 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36777e34-6dae-4f47-b984-ede20ae340a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:49.913966 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-36777e34-6dae-4f47-b984-ede20ae340a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:50.298504 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-36777e34-6dae-4f47-b984-ede20ae340a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:50.308399 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-36777e34-6dae-4f47-b984-ede20ae340a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:50.310620 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-36777e34-6dae-4f47-b984-ede20ae340a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:50.312075 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-36777e34-6dae-4f47-b984-ede20ae340a7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1596 microversion: 2.20 time: 0.416954 Aug 10 03:44:50.313215 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 509/1001] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:44:49 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1596 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:44:50.331817 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-28d4ad66-5b98-4de7-867d-f60acdc3722d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:50.336936 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-28d4ad66-5b98-4de7-867d-f60acdc3722d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:50.340965 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-28d4ad66-5b98-4de7-867d-f60acdc3722d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:50.343157 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-28d4ad66-5b98-4de7-867d-f60acdc3722d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:50.344455 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-28d4ad66-5b98-4de7-867d-f60acdc3722d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:50.345358 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-28d4ad66-5b98-4de7-867d-f60acdc3722d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:50.514770 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-28d4ad66-5b98-4de7-867d-f60acdc3722d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.188365 Aug 10 03:44:50.516542 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 493/1002] 10.222.0.21 () {60 vars in 1316 bytes} [Tue Aug 10 03:44:50 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:44:50.678026 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f90f6bd0-8b93-48f2-9c84-d4ed51f1eb86 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:50.679119 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f90f6bd0-8b93-48f2-9c84-d4ed51f1eb86 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:50.691365 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f90f6bd0-8b93-48f2-9c84-d4ed51f1eb86 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:50.692706 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f90f6bd0-8b93-48f2-9c84-d4ed51f1eb86 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:50.694451 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f90f6bd0-8b93-48f2-9c84-d4ed51f1eb86 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:50.694896 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f90f6bd0-8b93-48f2-9c84-d4ed51f1eb86 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:50.791238 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f90f6bd0-8b93-48f2-9c84-d4ed51f1eb86 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 14 microversion: 2.1 time: 0.114467 Aug 10 03:44:50.791238 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 510/1003] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:44:50 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 03:44:50.798822 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-f451ee70-ebc6-404b-9990-7400e778c5d8 req-c6fb5e13-4b05-4006-a332-2c1c215ccbbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39489822-b8f1-4176-a07f-4b84b1cd3d67", "tag": "1fd204ba-f590-4c87-bff7-78c11eab8e44"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:50.800731 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:44:50.800731 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:44:50.808053 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-f451ee70-ebc6-404b-9990-7400e778c5d8 req-c6fb5e13-4b05-4006-a332-2c1c215ccbbf service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:50.808601 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-f451ee70-ebc6-404b-9990-7400e778c5d8 req-c6fb5e13-4b05-4006-a332-2c1c215ccbbf service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:50.819883 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-f451ee70-ebc6-404b-9990-7400e778c5d8 req-c6fb5e13-4b05-4006-a332-2c1c215ccbbf service nova] Creating event network-changed:1fd204ba-f590-4c87-bff7-78c11eab8e44 for instance 39489822-b8f1-4176-a07f-4b84b1cd3d67 on hv-cinder-78239 Aug 10 03:44:50.825898 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-f451ee70-ebc6-404b-9990-7400e778c5d8 req-c6fb5e13-4b05-4006-a332-2c1c215ccbbf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030529 Aug 10 03:44:50.832384 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 494/1004] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:44:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:44:50.837315 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9074fa09-77a6-4640-9d6e-1be2576bf6e4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:50.838119 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9074fa09-77a6-4640-9d6e-1be2576bf6e4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:50.845512 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9074fa09-77a6-4640-9d6e-1be2576bf6e4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:50.846194 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9074fa09-77a6-4640-9d6e-1be2576bf6e4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:50.847140 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9074fa09-77a6-4640-9d6e-1be2576bf6e4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:50.847736 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9074fa09-77a6-4640-9d6e-1be2576bf6e4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:51.178342 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-9074fa09-77a6-4640-9d6e-1be2576bf6e4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:51.196820 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9074fa09-77a6-4640-9d6e-1be2576bf6e4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1319 microversion: 2.1 time: 0.364043 Aug 10 03:44:51.198161 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 511/1005] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:50 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:51.802767 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6392c1ba-ddbe-4c46-a2b2-d7c6576d4f93 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:51.803946 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6392c1ba-ddbe-4c46-a2b2-d7c6576d4f93 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:51.814376 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6392c1ba-ddbe-4c46-a2b2-d7c6576d4f93 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:51.815115 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6392c1ba-ddbe-4c46-a2b2-d7c6576d4f93 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:51.816296 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6392c1ba-ddbe-4c46-a2b2-d7c6576d4f93 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:51.817220 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6392c1ba-ddbe-4c46-a2b2-d7c6576d4f93 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:51.864400 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-041b260d-1897-4eb9-864d-bdef43e4b727 req-7c2c61be-906d-4f61-8aef-8749a32fa1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab91771-2631-4430-adf0-a39b63cfc1de", "name": "network-vif-plugged", "status": "completed", "tag": "887ed7fa-0ce1-4a88-8da2-e406a0557f46"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:51.866171 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:44:51.866171 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:44:51.879708 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-041b260d-1897-4eb9-864d-bdef43e4b727 req-7c2c61be-906d-4f61-8aef-8749a32fa1b8 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:51.880354 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-041b260d-1897-4eb9-864d-bdef43e4b727 req-7c2c61be-906d-4f61-8aef-8749a32fa1b8 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:51.895372 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-041b260d-1897-4eb9-864d-bdef43e4b727 req-7c2c61be-906d-4f61-8aef-8749a32fa1b8 service nova] Creating event network-vif-plugged:887ed7fa-0ce1-4a88-8da2-e406a0557f46 for instance 6ab91771-2631-4430-adf0-a39b63cfc1de on hv-cinder-78239 Aug 10 03:44:51.901277 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-041b260d-1897-4eb9-864d-bdef43e4b727 req-7c2c61be-906d-4f61-8aef-8749a32fa1b8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.391762 Aug 10 03:44:51.902247 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 495/1006] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:44:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:44:51.905761 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6392c1ba-ddbe-4c46-a2b2-d7c6576d4f93 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 14 microversion: 2.1 time: 0.107325 Aug 10 03:44:51.906641 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 512/1007] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:44:51 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:44:52.216528 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-732691ef-3306-40ab-ad86-f1925b3dbc68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:52.218454 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-732691ef-3306-40ab-ad86-f1925b3dbc68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:52.219574 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3ef711b6-71c9-400b-a335-021ee881ef95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:52.220355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3ef711b6-71c9-400b-a335-021ee881ef95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:52.230201 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3ef711b6-71c9-400b-a335-021ee881ef95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:52.230615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3ef711b6-71c9-400b-a335-021ee881ef95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:52.235197 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3ef711b6-71c9-400b-a335-021ee881ef95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:52.239462 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3ef711b6-71c9-400b-a335-021ee881ef95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:52.251161 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-732691ef-3306-40ab-ad86-f1925b3dbc68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:52.251869 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-732691ef-3306-40ab-ad86-f1925b3dbc68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:52.253838 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-732691ef-3306-40ab-ad86-f1925b3dbc68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:52.254493 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-732691ef-3306-40ab-ad86-f1925b3dbc68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:52.372385 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-732691ef-3306-40ab-ad86-f1925b3dbc68 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 14 microversion: 2.20 time: 0.167397 Aug 10 03:44:52.375998 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 496/1008] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:44:52 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:52.445272 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3ef711b6-71c9-400b-a335-021ee881ef95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:52.454274 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3ef711b6-71c9-400b-a335-021ee881ef95 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1319 microversion: 2.1 time: 0.243897 Aug 10 03:44:52.460481 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 513/1009] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:52 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:52.874819 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-044472c9-ae66-4fd8-838a-670552f8789f req-51c9edd7-43e2-47b6-9728-9e1678cb77fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c37790e-ad20-4784-b0f0-20babcf19223", "tag": "638e6702-b0f3-46b1-b6c2-197d8b06363d"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:52.876401 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:44:52.876401 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:44:52.884145 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-044472c9-ae66-4fd8-838a-670552f8789f req-51c9edd7-43e2-47b6-9728-9e1678cb77fe service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:52.884798 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-044472c9-ae66-4fd8-838a-670552f8789f req-51c9edd7-43e2-47b6-9728-9e1678cb77fe service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:52.900101 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-044472c9-ae66-4fd8-838a-670552f8789f req-51c9edd7-43e2-47b6-9728-9e1678cb77fe service nova] Creating event network-changed:638e6702-b0f3-46b1-b6c2-197d8b06363d for instance 5c37790e-ad20-4784-b0f0-20babcf19223 on hv-cinder-78239 Aug 10 03:44:52.906581 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-044472c9-ae66-4fd8-838a-670552f8789f req-51c9edd7-43e2-47b6-9728-9e1678cb77fe service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036877 Aug 10 03:44:52.908138 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 497/1010] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:44:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:44:52.917964 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0c33f055-3466-4315-aace-f2d07fbb1aca tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:52.919323 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0c33f055-3466-4315-aace-f2d07fbb1aca tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:52.928835 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0c33f055-3466-4315-aace-f2d07fbb1aca tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:52.929790 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0c33f055-3466-4315-aace-f2d07fbb1aca tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:52.931645 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0c33f055-3466-4315-aace-f2d07fbb1aca tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:52.933212 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0c33f055-3466-4315-aace-f2d07fbb1aca tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:53.040997 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0c33f055-3466-4315-aace-f2d07fbb1aca tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 14 microversion: 2.1 time: 0.127259 Aug 10 03:44:53.042543 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 514/1011] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:44:52 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:44:53.123874 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a49a3611-99e7-48a9-8930-8182ad294261 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1871543112"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:53.125087 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a49a3611-99e7-48a9-8930-8182ad294261 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:53.135335 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a49a3611-99e7-48a9-8930-8182ad294261 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:53.135845 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a49a3611-99e7-48a9-8930-8182ad294261 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:53.137506 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a49a3611-99e7-48a9-8930-8182ad294261 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:53.137947 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a49a3611-99e7-48a9-8930-8182ad294261 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:53.383761 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d722bf3c-2f19-4ff6-822c-8fa833e5a593 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:53.384824 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d722bf3c-2f19-4ff6-822c-8fa833e5a593 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:53.392885 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d722bf3c-2f19-4ff6-822c-8fa833e5a593 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:53.393845 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d722bf3c-2f19-4ff6-822c-8fa833e5a593 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:53.394981 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d722bf3c-2f19-4ff6-822c-8fa833e5a593 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:53.395513 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d722bf3c-2f19-4ff6-822c-8fa833e5a593 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:53.529251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d722bf3c-2f19-4ff6-822c-8fa833e5a593 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 14 microversion: 2.20 time: 0.112843 Aug 10 03:44:53.529251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 515/1012] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:44:53 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:53.529251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-346af3e2-0773-4278-9638-d6a5b34f197b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:53.529251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-346af3e2-0773-4278-9638-d6a5b34f197b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:53.529251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-346af3e2-0773-4278-9638-d6a5b34f197b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:53.530057 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-346af3e2-0773-4278-9638-d6a5b34f197b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:53.530057 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-346af3e2-0773-4278-9638-d6a5b34f197b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:53.530057 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-346af3e2-0773-4278-9638-d6a5b34f197b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:53.645593 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.network.security_group_api [None req-a49a3611-99e7-48a9-8930-8182ad294261 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Adding security group 340df404-620c-44f6-ab98-79f03bb47b3f to port e4c32421-6086-4a06-97cd-96e3d3edc391 Aug 10 03:44:53.673806 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-346af3e2-0773-4278-9638-d6a5b34f197b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:53.683668 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-346af3e2-0773-4278-9638-d6a5b34f197b tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1319 microversion: 2.1 time: 0.189184 Aug 10 03:44:53.684651 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 516/1013] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:53 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:54.053009 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c316c55f-b316-44e9-bc66-7a11c4327a2d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:54.054071 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c316c55f-b316-44e9-bc66-7a11c4327a2d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:54.060716 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c316c55f-b316-44e9-bc66-7a11c4327a2d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:54.061169 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c316c55f-b316-44e9-bc66-7a11c4327a2d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:54.062162 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c316c55f-b316-44e9-bc66-7a11c4327a2d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:54.062586 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c316c55f-b316-44e9-bc66-7a11c4327a2d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:54.145597 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c316c55f-b316-44e9-bc66-7a11c4327a2d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 14 microversion: 2.1 time: 0.095450 Aug 10 03:44:54.152935 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 517/1014] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:44:54 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 03:44:54.340540 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a49a3611-99e7-48a9-8930-8182ad294261 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "POST /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/action" status: 202 len: 0 microversion: 2.1 time: 1.221277 Aug 10 03:44:54.341146 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 498/1015] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:44:53 2021] POST /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/action => generated 0 bytes in 1223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:44:54.350477 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f737326d-2322-4404-a865-ac8591770a86 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:54.351176 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f737326d-2322-4404-a865-ac8591770a86 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:54.359327 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f737326d-2322-4404-a865-ac8591770a86 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:54.359839 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f737326d-2322-4404-a865-ac8591770a86 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:54.360647 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f737326d-2322-4404-a865-ac8591770a86 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:54.361208 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f737326d-2322-4404-a865-ac8591770a86 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:54.502938 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6886bf23-d146-4de5-812b-9eda90528516 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:54.503843 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6886bf23-d146-4de5-812b-9eda90528516 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:54.518092 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6886bf23-d146-4de5-812b-9eda90528516 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:54.519142 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6886bf23-d146-4de5-812b-9eda90528516 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:54.520142 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6886bf23-d146-4de5-812b-9eda90528516 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:54.520786 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6886bf23-d146-4de5-812b-9eda90528516 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:54.562126 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f737326d-2322-4404-a865-ac8591770a86 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:54.579091 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f737326d-2322-4404-a865-ac8591770a86 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1760 microversion: 2.1 time: 0.232425 Aug 10 03:44:54.593695 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 518/1016] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:54 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1760 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:54.646027 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6886bf23-d146-4de5-812b-9eda90528516 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 14 microversion: 2.20 time: 0.146598 Aug 10 03:44:54.649216 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 499/1017] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:44:54 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:54.700306 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e2f23998-d633-4659-9ac9-9c38de35d2d9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:44:54.701048 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e2f23998-d633-4659-9ac9-9c38de35d2d9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:54.708273 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e2f23998-d633-4659-9ac9-9c38de35d2d9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:54.709049 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e2f23998-d633-4659-9ac9-9c38de35d2d9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:54.711229 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e2f23998-d633-4659-9ac9-9c38de35d2d9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:54.711770 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e2f23998-d633-4659-9ac9-9c38de35d2d9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:54.859178 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e2f23998-d633-4659-9ac9-9c38de35d2d9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:44:54.867503 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e2f23998-d633-4659-9ac9-9c38de35d2d9 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1507 microversion: 2.1 time: 0.170856 Aug 10 03:44:54.868279 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 519/1018] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:44:54 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:54.890868 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3ceb2c9b-6764-4a1e-a596-d7226efb48ca tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d67f9de-e71a-4098-a55a-4f1c3a86b072", "device": "/dev/sdb"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:54.893345 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3ceb2c9b-6764-4a1e-a596-d7226efb48ca tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:54.900223 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3ceb2c9b-6764-4a1e-a596-d7226efb48ca tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:54.900796 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3ceb2c9b-6764-4a1e-a596-d7226efb48ca tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:54.902257 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3ceb2c9b-6764-4a1e-a596-d7226efb48ca tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:54.902691 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3ceb2c9b-6764-4a1e-a596-d7226efb48ca tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:54.924877 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-99f15050-a38a-4d2c-b4dd-07411800ecaa req-f7a56816-73d2-4a30-b536-e9178addde7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2969b784-ae47-4dce-a4d1-f86c2d508de8", "tag": "e4c32421-6086-4a06-97cd-96e3d3edc391"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:54.926798 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:44:54.926798 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:44:54.936327 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-99f15050-a38a-4d2c-b4dd-07411800ecaa req-f7a56816-73d2-4a30-b536-e9178addde7e service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:54.936890 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-99f15050-a38a-4d2c-b4dd-07411800ecaa req-f7a56816-73d2-4a30-b536-e9178addde7e service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:54.951148 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-99f15050-a38a-4d2c-b4dd-07411800ecaa req-f7a56816-73d2-4a30-b536-e9178addde7e service nova] Creating event network-changed:e4c32421-6086-4a06-97cd-96e3d3edc391 for instance 2969b784-ae47-4dce-a4d1-f86c2d508de8 on hv-cinder-78239 Aug 10 03:44:54.956642 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-99f15050-a38a-4d2c-b4dd-07411800ecaa req-f7a56816-73d2-4a30-b536-e9178addde7e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036571 Aug 10 03:44:54.957868 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 520/1019] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:44:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:44:55.164186 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-44555542-c6d3-4409-8d11-e1bda2a0071c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:55.165334 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-44555542-c6d3-4409-8d11-e1bda2a0071c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:55.188041 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-44555542-c6d3-4409-8d11-e1bda2a0071c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:55.188992 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-44555542-c6d3-4409-8d11-e1bda2a0071c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:55.189714 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-44555542-c6d3-4409-8d11-e1bda2a0071c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:55.190355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-44555542-c6d3-4409-8d11-e1bda2a0071c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:55.289569 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-44555542-c6d3-4409-8d11-e1bda2a0071c tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 14 microversion: 2.1 time: 0.129920 Aug 10 03:44:55.290909 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 521/1020] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:44:55 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:44:55.657686 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-15aa907b-84d9-4c4b-9e49-78c5cf11c04c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:55.658665 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-15aa907b-84d9-4c4b-9e49-78c5cf11c04c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:55.665547 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-15aa907b-84d9-4c4b-9e49-78c5cf11c04c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:55.665990 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-15aa907b-84d9-4c4b-9e49-78c5cf11c04c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:55.667312 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-15aa907b-84d9-4c4b-9e49-78c5cf11c04c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:55.667740 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-15aa907b-84d9-4c4b-9e49-78c5cf11c04c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:55.754032 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-15aa907b-84d9-4c4b-9e49-78c5cf11c04c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 14 microversion: 2.20 time: 0.100008 Aug 10 03:44:55.757335 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 522/1021] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:44:55 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:44:55.778418 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3ceb2c9b-6764-4a1e-a596-d7226efb48ca tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "POST /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.895385 Aug 10 03:44:55.779084 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 500/1022] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 10 03:44:54 2021] POST /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de/os-volume_attachments => generated 194 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:44:56.305356 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-50ea13f1-2922-4e4f-9fcb-d8e13d6f489d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:56.306586 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-50ea13f1-2922-4e4f-9fcb-d8e13d6f489d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:56.314858 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-50ea13f1-2922-4e4f-9fcb-d8e13d6f489d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:56.319725 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-50ea13f1-2922-4e4f-9fcb-d8e13d6f489d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:56.319725 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-50ea13f1-2922-4e4f-9fcb-d8e13d6f489d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:56.319725 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-50ea13f1-2922-4e4f-9fcb-d8e13d6f489d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:56.409276 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-50ea13f1-2922-4e4f-9fcb-d8e13d6f489d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 14 microversion: 2.1 time: 0.108637 Aug 10 03:44:56.409973 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 523/1023] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:44:56 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:44:56.764919 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-fd03ce28-8a51-4355-b4d7-06dda8114cf6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:56.766183 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-fd03ce28-8a51-4355-b4d7-06dda8114cf6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:56.775012 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fd03ce28-8a51-4355-b4d7-06dda8114cf6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:56.775555 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fd03ce28-8a51-4355-b4d7-06dda8114cf6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:56.776507 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fd03ce28-8a51-4355-b4d7-06dda8114cf6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:56.777022 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fd03ce28-8a51-4355-b4d7-06dda8114cf6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:56.881389 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-fd03ce28-8a51-4355-b4d7-06dda8114cf6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 14 microversion: 2.20 time: 0.120620 Aug 10 03:44:56.882040 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 501/1024] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:44:56 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:57.420671 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ab89672f-2070-4be7-88f9-8510f1cbe413 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:57.421678 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ab89672f-2070-4be7-88f9-8510f1cbe413 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:57.429060 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ab89672f-2070-4be7-88f9-8510f1cbe413 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:57.429605 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ab89672f-2070-4be7-88f9-8510f1cbe413 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:57.430516 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ab89672f-2070-4be7-88f9-8510f1cbe413 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:57.431037 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ab89672f-2070-4be7-88f9-8510f1cbe413 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:57.535400 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ab89672f-2070-4be7-88f9-8510f1cbe413 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 14 microversion: 2.1 time: 0.118458 Aug 10 03:44:57.539408 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 524/1025] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:44:57 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:44:57.894416 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-99c9ba85-4b6d-4061-97fa-9955db9330e2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:57.895559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-99c9ba85-4b6d-4061-97fa-9955db9330e2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:57.903031 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-99c9ba85-4b6d-4061-97fa-9955db9330e2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:57.903580 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-99c9ba85-4b6d-4061-97fa-9955db9330e2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:57.904442 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-99c9ba85-4b6d-4061-97fa-9955db9330e2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:57.904948 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-99c9ba85-4b6d-4061-97fa-9955db9330e2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:58.001388 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-99c9ba85-4b6d-4061-97fa-9955db9330e2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 14 microversion: 2.20 time: 0.111721 Aug 10 03:44:58.002373 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 502/1026] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:44:57 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:58.548832 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-838a8262-666c-41cd-ba14-46b35ae54622 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:58.550229 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-838a8262-666c-41cd-ba14-46b35ae54622 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:58.563500 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-838a8262-666c-41cd-ba14-46b35ae54622 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:58.563500 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-838a8262-666c-41cd-ba14-46b35ae54622 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:58.563500 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-838a8262-666c-41cd-ba14-46b35ae54622 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:58.563500 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-838a8262-666c-41cd-ba14-46b35ae54622 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:58.661254 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-838a8262-666c-41cd-ba14-46b35ae54622 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 14 microversion: 2.1 time: 0.116118 Aug 10 03:44:58.666447 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 525/1027] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:44:58 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:44:59.013254 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-bf064572-39c1-485c-b091-1b0c4a817f97 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:59.014342 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-bf064572-39c1-485c-b091-1b0c4a817f97 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:59.020881 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bf064572-39c1-485c-b091-1b0c4a817f97 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:59.021889 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bf064572-39c1-485c-b091-1b0c4a817f97 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:59.022125 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bf064572-39c1-485c-b091-1b0c4a817f97 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:59.022608 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bf064572-39c1-485c-b091-1b0c4a817f97 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:59.118650 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-bf064572-39c1-485c-b091-1b0c4a817f97 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 14 microversion: 2.20 time: 0.109171 Aug 10 03:44:59.119162 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 503/1028] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:44:59 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:44:59.675591 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e3225004-be4e-4773-99bc-03eb2cb9b025 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:44:59.677280 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e3225004-be4e-4773-99bc-03eb2cb9b025 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:44:59.684685 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3225004-be4e-4773-99bc-03eb2cb9b025 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:59.685377 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3225004-be4e-4773-99bc-03eb2cb9b025 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:59.686423 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3225004-be4e-4773-99bc-03eb2cb9b025 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:44:59.687059 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3225004-be4e-4773-99bc-03eb2cb9b025 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:44:59.793172 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e3225004-be4e-4773-99bc-03eb2cb9b025 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 14 microversion: 2.1 time: 0.121014 Aug 10 03:44:59.793957 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 526/1029] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:44:59 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:45:00.131197 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d9e18a0e-f48d-4f36-b7f9-eb47d5c8c4e6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:00.132987 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d9e18a0e-f48d-4f36-b7f9-eb47d5c8c4e6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:00.138977 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d9e18a0e-f48d-4f36-b7f9-eb47d5c8c4e6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:00.139424 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d9e18a0e-f48d-4f36-b7f9-eb47d5c8c4e6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:00.140246 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d9e18a0e-f48d-4f36-b7f9-eb47d5c8c4e6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:00.140683 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d9e18a0e-f48d-4f36-b7f9-eb47d5c8c4e6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:00.236606 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d9e18a0e-f48d-4f36-b7f9-eb47d5c8c4e6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 14 microversion: 2.20 time: 0.109329 Aug 10 03:45:00.237269 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 504/1030] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:00 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:00.806775 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-7363227b-e2ec-4e4a-8424-79c0bb8dc4d4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:00.808314 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-7363227b-e2ec-4e4a-8424-79c0bb8dc4d4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:00.815325 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7363227b-e2ec-4e4a-8424-79c0bb8dc4d4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:00.815769 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7363227b-e2ec-4e4a-8424-79c0bb8dc4d4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:00.816633 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7363227b-e2ec-4e4a-8424-79c0bb8dc4d4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:00.817186 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7363227b-e2ec-4e4a-8424-79c0bb8dc4d4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:00.928361 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-7363227b-e2ec-4e4a-8424-79c0bb8dc4d4 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 10893 microversion: 2.1 time: 0.125524 Aug 10 03:45:00.929917 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 527/1031] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:00 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 10893 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:01.247981 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8f01f77c-484f-4955-84ac-7ea8c963e3b6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:01.248993 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8f01f77c-484f-4955-84ac-7ea8c963e3b6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:01.255442 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8f01f77c-484f-4955-84ac-7ea8c963e3b6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:01.255885 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8f01f77c-484f-4955-84ac-7ea8c963e3b6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:01.256693 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8f01f77c-484f-4955-84ac-7ea8c963e3b6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:01.257125 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8f01f77c-484f-4955-84ac-7ea8c963e3b6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:01.350015 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8f01f77c-484f-4955-84ac-7ea8c963e3b6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 14 microversion: 2.20 time: 0.106474 Aug 10 03:45:01.350565 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 505/1032] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:01 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:01.941765 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-07f77067-ff8a-4990-8b05-cfc4ad6caba8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:01.942727 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-07f77067-ff8a-4990-8b05-cfc4ad6caba8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:01.949874 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-07f77067-ff8a-4990-8b05-cfc4ad6caba8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:01.953938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-07f77067-ff8a-4990-8b05-cfc4ad6caba8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:01.953938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-07f77067-ff8a-4990-8b05-cfc4ad6caba8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:01.953938 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-07f77067-ff8a-4990-8b05-cfc4ad6caba8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:02.062840 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-07f77067-ff8a-4990-8b05-cfc4ad6caba8 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 16403 microversion: 2.1 time: 0.124954 Aug 10 03:45:02.064098 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 528/1033] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:01 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 16403 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:02.363963 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-089b78f5-eb2d-4143-bfe3-f8ec45481b14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:02.365035 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-089b78f5-eb2d-4143-bfe3-f8ec45481b14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:02.371590 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-089b78f5-eb2d-4143-bfe3-f8ec45481b14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:02.372077 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-089b78f5-eb2d-4143-bfe3-f8ec45481b14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:02.372872 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-089b78f5-eb2d-4143-bfe3-f8ec45481b14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:02.373303 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-089b78f5-eb2d-4143-bfe3-f8ec45481b14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:02.476446 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-089b78f5-eb2d-4143-bfe3-f8ec45481b14 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 14 microversion: 2.20 time: 0.116349 Aug 10 03:45:02.477075 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 506/1034] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:02 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:03.078859 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-892e3773-75ce-4a2a-bdbf-5afa69304fd9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:03.079922 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-892e3773-75ce-4a2a-bdbf-5afa69304fd9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:03.086513 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-892e3773-75ce-4a2a-bdbf-5afa69304fd9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:03.087046 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-892e3773-75ce-4a2a-bdbf-5afa69304fd9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:03.087861 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-892e3773-75ce-4a2a-bdbf-5afa69304fd9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:03.088398 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-892e3773-75ce-4a2a-bdbf-5afa69304fd9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:03.205129 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-892e3773-75ce-4a2a-bdbf-5afa69304fd9 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 18305 microversion: 2.1 time: 0.129986 Aug 10 03:45:03.205959 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 529/1035] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:03 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 18305 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:45:03.488811 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-2c2c6529-4e32-4ce5-be6e-adc71c5c3271 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:03.490896 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-2c2c6529-4e32-4ce5-be6e-adc71c5c3271 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:03.500429 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2c2c6529-4e32-4ce5-be6e-adc71c5c3271 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:03.500429 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2c2c6529-4e32-4ce5-be6e-adc71c5c3271 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:03.500429 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2c2c6529-4e32-4ce5-be6e-adc71c5c3271 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:03.501011 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2c2c6529-4e32-4ce5-be6e-adc71c5c3271 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:03.620982 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-2c2c6529-4e32-4ce5-be6e-adc71c5c3271 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 6748 microversion: 2.20 time: 0.136206 Aug 10 03:45:03.621788 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 507/1036] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:03 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 6748 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:45:04.219541 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-41e7aafb-fc10-44a0-800e-1debc464835e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:04.220747 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-41e7aafb-fc10-44a0-800e-1debc464835e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:04.228055 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-41e7aafb-fc10-44a0-800e-1debc464835e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:04.228557 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-41e7aafb-fc10-44a0-800e-1debc464835e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:04.231023 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-41e7aafb-fc10-44a0-800e-1debc464835e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:04.231023 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-41e7aafb-fc10-44a0-800e-1debc464835e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:04.331559 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-41e7aafb-fc10-44a0-800e-1debc464835e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 19722 microversion: 2.1 time: 0.116490 Aug 10 03:45:04.332673 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 530/1037] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:04 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 19722 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:04.636746 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1825da92-fe72-4fa5-b7ab-df25d8dfc662 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:04.637532 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1825da92-fe72-4fa5-b7ab-df25d8dfc662 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:04.644760 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1825da92-fe72-4fa5-b7ab-df25d8dfc662 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:04.645452 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1825da92-fe72-4fa5-b7ab-df25d8dfc662 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:04.646338 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1825da92-fe72-4fa5-b7ab-df25d8dfc662 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:04.646889 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1825da92-fe72-4fa5-b7ab-df25d8dfc662 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:04.761550 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1825da92-fe72-4fa5-b7ab-df25d8dfc662 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 15025 microversion: 2.20 time: 0.129650 Aug 10 03:45:04.762374 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 508/1038] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:04 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 15025 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:05.344000 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f8bbc007-0a43-4019-aa87-25ee19f57b9b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:05.345143 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f8bbc007-0a43-4019-aa87-25ee19f57b9b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:05.355479 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8bbc007-0a43-4019-aa87-25ee19f57b9b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:05.355479 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8bbc007-0a43-4019-aa87-25ee19f57b9b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:05.355479 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8bbc007-0a43-4019-aa87-25ee19f57b9b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:05.355479 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8bbc007-0a43-4019-aa87-25ee19f57b9b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:05.464942 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f8bbc007-0a43-4019-aa87-25ee19f57b9b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 22217 microversion: 2.1 time: 0.124629 Aug 10 03:45:05.465786 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 531/1039] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:05 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 22217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:05.774525 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7fbc7668-2420-4633-838b-e76e74e89d38 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:05.776679 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7fbc7668-2420-4633-838b-e76e74e89d38 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:05.784425 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7fbc7668-2420-4633-838b-e76e74e89d38 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:05.785210 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7fbc7668-2420-4633-838b-e76e74e89d38 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:05.785994 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7fbc7668-2420-4633-838b-e76e74e89d38 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:05.786431 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7fbc7668-2420-4633-838b-e76e74e89d38 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:06.478214 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-69fe0c73-0dbe-4d0c-884f-2adb0a973848 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:06.479716 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-69fe0c73-0dbe-4d0c-884f-2adb0a973848 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:06.486866 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-69fe0c73-0dbe-4d0c-884f-2adb0a973848 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:06.487308 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-69fe0c73-0dbe-4d0c-884f-2adb0a973848 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:06.488083 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-69fe0c73-0dbe-4d0c-884f-2adb0a973848 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:06.488535 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-69fe0c73-0dbe-4d0c-884f-2adb0a973848 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:08.776776 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7fbc7668-2420-4633-838b-e76e74e89d38 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 22095 microversion: 2.20 time: 3.005632 Aug 10 03:45:08.777517 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 509/1040] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:05 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 22095 bytes in 3009 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:08.782469 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-238d053b-aa52-4afd-aad2-d77cdabc3e1e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:08.783506 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-238d053b-aa52-4afd-aad2-d77cdabc3e1e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:08.789892 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-238d053b-aa52-4afd-aad2-d77cdabc3e1e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:08.790332 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-238d053b-aa52-4afd-aad2-d77cdabc3e1e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:08.791090 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-238d053b-aa52-4afd-aad2-d77cdabc3e1e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:08.791519 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-238d053b-aa52-4afd-aad2-d77cdabc3e1e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:08.815763 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-69fe0c73-0dbe-4d0c-884f-2adb0a973848 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 24965 microversion: 2.1 time: 2.341351 Aug 10 03:45:08.817164 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 532/1041] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:06 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 24965 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:45:09.051255 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-238d053b-aa52-4afd-aad2-d77cdabc3e1e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "POST /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/action" status: 202 len: 0 microversion: 2.1 time: 0.272330 Aug 10 03:45:09.052372 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 510/1042] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:08 2021] POST /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:09.060446 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-bd7190d6-a55f-40f8-ae86-d49d1cfb6279 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:09.061149 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-bd7190d6-a55f-40f8-ae86-d49d1cfb6279 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:09.067624 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd7190d6-a55f-40f8-ae86-d49d1cfb6279 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:09.073643 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd7190d6-a55f-40f8-ae86-d49d1cfb6279 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:09.073643 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd7190d6-a55f-40f8-ae86-d49d1cfb6279 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:09.073643 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd7190d6-a55f-40f8-ae86-d49d1cfb6279 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:09.214443 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-bd7190d6-a55f-40f8-ae86-d49d1cfb6279 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:09.222615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-bd7190d6-a55f-40f8-ae86-d49d1cfb6279 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1752 microversion: 2.1 time: 0.166463 Aug 10 03:45:09.223179 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 533/1043] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:09 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:09.790063 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8893a456-106d-4037-8e7b-c907d85939ab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:09.792291 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8893a456-106d-4037-8e7b-c907d85939ab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:09.798594 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8893a456-106d-4037-8e7b-c907d85939ab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:09.799043 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8893a456-106d-4037-8e7b-c907d85939ab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:09.799825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8893a456-106d-4037-8e7b-c907d85939ab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:09.800273 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8893a456-106d-4037-8e7b-c907d85939ab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:09.827271 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e5f22dff-7598-446c-90d5-12ffd2f43377 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:09.828982 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e5f22dff-7598-446c-90d5-12ffd2f43377 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:09.837545 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5f22dff-7598-446c-90d5-12ffd2f43377 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:09.837988 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5f22dff-7598-446c-90d5-12ffd2f43377 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:09.839262 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5f22dff-7598-446c-90d5-12ffd2f43377 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:09.839695 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e5f22dff-7598-446c-90d5-12ffd2f43377 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:09.954634 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8893a456-106d-4037-8e7b-c907d85939ab tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 23206 microversion: 2.20 time: 0.168586 Aug 10 03:45:09.958346 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 511/1044] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:09 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 23206 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:09.997168 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e5f22dff-7598-446c-90d5-12ffd2f43377 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 26154 microversion: 2.1 time: 0.173437 Aug 10 03:45:09.997872 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 534/1045] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:09 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 26154 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:45:10.239660 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-aa658ff0-490a-4141-9205-65fad674f46e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:10.240360 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-aa658ff0-490a-4141-9205-65fad674f46e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:10.247157 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aa658ff0-490a-4141-9205-65fad674f46e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:10.247718 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aa658ff0-490a-4141-9205-65fad674f46e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:10.248556 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aa658ff0-490a-4141-9205-65fad674f46e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:10.249103 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aa658ff0-490a-4141-9205-65fad674f46e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:10.378822 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-aa658ff0-490a-4141-9205-65fad674f46e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:10.387236 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-aa658ff0-490a-4141-9205-65fad674f46e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1757 microversion: 2.1 time: 0.151758 Aug 10 03:45:10.387787 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 512/1046] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:10 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1757 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:10.967267 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d400dafd-3c3b-46e7-9425-0b952cf92114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:10.968106 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d400dafd-3c3b-46e7-9425-0b952cf92114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:10.974540 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d400dafd-3c3b-46e7-9425-0b952cf92114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:10.974978 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d400dafd-3c3b-46e7-9425-0b952cf92114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:10.975797 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d400dafd-3c3b-46e7-9425-0b952cf92114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:10.976246 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d400dafd-3c3b-46e7-9425-0b952cf92114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:11.009608 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4dc962ed-d728-45b0-8349-8292cc3d2b86 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:11.011068 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4dc962ed-d728-45b0-8349-8292cc3d2b86 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:11.017024 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4dc962ed-d728-45b0-8349-8292cc3d2b86 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:11.017463 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4dc962ed-d728-45b0-8349-8292cc3d2b86 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:11.018224 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4dc962ed-d728-45b0-8349-8292cc3d2b86 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:11.018649 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4dc962ed-d728-45b0-8349-8292cc3d2b86 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:13.296670 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d400dafd-3c3b-46e7-9425-0b952cf92114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 25925 microversion: 2.20 time: 2.333842 Aug 10 03:45:13.297254 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 535/1047] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:10 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 25925 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:13.301972 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-50a2eca5-b580-41b7-95d2-678cd526b9eb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:13.302663 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-50a2eca5-b580-41b7-95d2-678cd526b9eb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:13.309110 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-50a2eca5-b580-41b7-95d2-678cd526b9eb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:13.309550 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-50a2eca5-b580-41b7-95d2-678cd526b9eb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:13.310303 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-50a2eca5-b580-41b7-95d2-678cd526b9eb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:13.310729 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-50a2eca5-b580-41b7-95d2-678cd526b9eb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:13.346839 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4dc962ed-d728-45b0-8349-8292cc3d2b86 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 27610 microversion: 2.1 time: 2.341399 Aug 10 03:45:13.347676 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 513/1048] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:11 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 27610 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:45:13.434837 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-50a2eca5-b580-41b7-95d2-678cd526b9eb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:13.442605 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-50a2eca5-b580-41b7-95d2-678cd526b9eb tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1757 microversion: 2.1 time: 0.144290 Aug 10 03:45:13.443157 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 536/1049] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:13 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1757 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:14.308924 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e5b06b98-1d32-4c4f-b463-1548e965a615 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:14.309900 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e5b06b98-1d32-4c4f-b463-1548e965a615 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:14.316461 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e5b06b98-1d32-4c4f-b463-1548e965a615 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:14.316892 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e5b06b98-1d32-4c4f-b463-1548e965a615 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:14.317663 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e5b06b98-1d32-4c4f-b463-1548e965a615 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:14.318097 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e5b06b98-1d32-4c4f-b463-1548e965a615 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:14.360124 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f719b3f5-09fe-4e71-bb5b-43265c8cc0e7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:14.361119 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f719b3f5-09fe-4e71-bb5b-43265c8cc0e7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:14.367310 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f719b3f5-09fe-4e71-bb5b-43265c8cc0e7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:14.367758 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f719b3f5-09fe-4e71-bb5b-43265c8cc0e7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:14.368549 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f719b3f5-09fe-4e71-bb5b-43265c8cc0e7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:14.368990 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f719b3f5-09fe-4e71-bb5b-43265c8cc0e7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:14.425874 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e5b06b98-1d32-4c4f-b463-1548e965a615 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 26784 microversion: 2.20 time: 0.120921 Aug 10 03:45:14.426658 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 514/1050] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:14 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 26784 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:14.461757 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-22bc93cc-5717-43d4-a441-b86b36f9ff25 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:14.462459 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-22bc93cc-5717-43d4-a441-b86b36f9ff25 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:14.469527 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-22bc93cc-5717-43d4-a441-b86b36f9ff25 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:14.469975 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-22bc93cc-5717-43d4-a441-b86b36f9ff25 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:14.470746 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-22bc93cc-5717-43d4-a441-b86b36f9ff25 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:14.471180 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-22bc93cc-5717-43d4-a441-b86b36f9ff25 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:14.495791 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f719b3f5-09fe-4e71-bb5b-43265c8cc0e7 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 27987 microversion: 2.1 time: 0.139529 Aug 10 03:45:14.500122 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 537/1051] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:14 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 27987 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:45:14.598604 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-22bc93cc-5717-43d4-a441-b86b36f9ff25 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:14.607095 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-22bc93cc-5717-43d4-a441-b86b36f9ff25 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1757 microversion: 2.1 time: 0.149200 Aug 10 03:45:14.607906 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 515/1052] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:14 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1757 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:45:15.438968 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6a633f5c-4a3c-4d90-9d47-0503ecb60835 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:15.439963 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6a633f5c-4a3c-4d90-9d47-0503ecb60835 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:15.449236 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6a633f5c-4a3c-4d90-9d47-0503ecb60835 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:15.450000 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6a633f5c-4a3c-4d90-9d47-0503ecb60835 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:15.451265 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6a633f5c-4a3c-4d90-9d47-0503ecb60835 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:15.451992 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6a633f5c-4a3c-4d90-9d47-0503ecb60835 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:15.507666 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ecd59e51-abcd-4c72-9080-6be60e5fdaa6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:15.508729 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ecd59e51-abcd-4c72-9080-6be60e5fdaa6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:15.515239 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ecd59e51-abcd-4c72-9080-6be60e5fdaa6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:15.515771 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ecd59e51-abcd-4c72-9080-6be60e5fdaa6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:15.516650 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ecd59e51-abcd-4c72-9080-6be60e5fdaa6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:15.517170 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ecd59e51-abcd-4c72-9080-6be60e5fdaa6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:15.584267 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6a633f5c-4a3c-4d90-9d47-0503ecb60835 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 27409 microversion: 2.20 time: 0.149098 Aug 10 03:45:15.585136 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 538/1053] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:15 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 27409 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:45:15.626385 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1ac4328a-98b9-4750-8a3e-36214d49f9df tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:15.628248 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1ac4328a-98b9-4750-8a3e-36214d49f9df tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:15.633512 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1ac4328a-98b9-4750-8a3e-36214d49f9df tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:15.633959 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1ac4328a-98b9-4750-8a3e-36214d49f9df tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:15.634726 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1ac4328a-98b9-4750-8a3e-36214d49f9df tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:15.635210 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1ac4328a-98b9-4750-8a3e-36214d49f9df tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:15.669905 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ecd59e51-abcd-4c72-9080-6be60e5fdaa6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 28221 microversion: 2.1 time: 0.165794 Aug 10 03:45:15.670785 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 516/1054] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:15 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 28221 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:45:15.803971 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1ac4328a-98b9-4750-8a3e-36214d49f9df tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:15.812007 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1ac4328a-98b9-4750-8a3e-36214d49f9df tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1757 microversion: 2.1 time: 0.189556 Aug 10 03:45:15.812594 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 539/1055] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:15 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:45:16.597523 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-626a7f24-870d-4bb3-a0b0-a5f1f492c348 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:16.598514 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-626a7f24-870d-4bb3-a0b0-a5f1f492c348 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:16.605077 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-626a7f24-870d-4bb3-a0b0-a5f1f492c348 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:16.605566 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-626a7f24-870d-4bb3-a0b0-a5f1f492c348 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:16.606325 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-626a7f24-870d-4bb3-a0b0-a5f1f492c348 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:16.606749 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-626a7f24-870d-4bb3-a0b0-a5f1f492c348 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:16.682386 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5e30c857-9f4c-4149-a9dd-bffddd9a77b2 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:16.683273 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-5e30c857-9f4c-4149-a9dd-bffddd9a77b2 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:16.689215 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5e30c857-9f4c-4149-a9dd-bffddd9a77b2 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:16.689650 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5e30c857-9f4c-4149-a9dd-bffddd9a77b2 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:16.690402 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5e30c857-9f4c-4149-a9dd-bffddd9a77b2 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:16.690826 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5e30c857-9f4c-4149-a9dd-bffddd9a77b2 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:16.734952 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-626a7f24-870d-4bb3-a0b0-a5f1f492c348 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 27768 microversion: 2.20 time: 0.141236 Aug 10 03:45:16.735741 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 517/1056] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:16 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 27768 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:16.805176 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5e30c857-9f4c-4149-a9dd-bffddd9a77b2 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 28221 microversion: 2.1 time: 0.126996 Aug 10 03:45:16.805961 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 540/1057] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:16 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 28221 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:45:16.830022 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-095e8c35-7c43-41b2-b920-bc05dd8e58b2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:16.830745 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-095e8c35-7c43-41b2-b920-bc05dd8e58b2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:16.837206 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-095e8c35-7c43-41b2-b920-bc05dd8e58b2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:16.837648 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-095e8c35-7c43-41b2-b920-bc05dd8e58b2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:16.838461 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-095e8c35-7c43-41b2-b920-bc05dd8e58b2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:16.838893 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-095e8c35-7c43-41b2-b920-bc05dd8e58b2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:16.963944 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-095e8c35-7c43-41b2-b920-bc05dd8e58b2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:16.972330 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-095e8c35-7c43-41b2-b920-bc05dd8e58b2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1757 microversion: 2.1 time: 0.146279 Aug 10 03:45:16.972893 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 518/1058] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:16 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1757 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:17.610866 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1f297156-0c6a-43aa-88cc-120ce12bd6d3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:17.611451 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1f297156-0c6a-43aa-88cc-120ce12bd6d3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:17.618301 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1f297156-0c6a-43aa-88cc-120ce12bd6d3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:17.618742 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1f297156-0c6a-43aa-88cc-120ce12bd6d3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:17.620101 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1f297156-0c6a-43aa-88cc-120ce12bd6d3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:17.620561 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1f297156-0c6a-43aa-88cc-120ce12bd6d3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:17.704243 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-1f297156-0c6a-43aa-88cc-120ce12bd6d3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lazy-loading 'services' on Instance uuid 6ab91771-2631-4430-adf0-a39b63cfc1de {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:45:17.746852 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-cb6fc1e7-84e7-48ae-a45b-0425d2d1845f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:17.747768 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-cb6fc1e7-84e7-48ae-a45b-0425d2d1845f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:17.753603 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb6fc1e7-84e7-48ae-a45b-0425d2d1845f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:17.754050 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb6fc1e7-84e7-48ae-a45b-0425d2d1845f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:17.754824 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb6fc1e7-84e7-48ae-a45b-0425d2d1845f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:17.755263 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cb6fc1e7-84e7-48ae-a45b-0425d2d1845f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:17.851462 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-cb6fc1e7-84e7-48ae-a45b-0425d2d1845f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 28138 microversion: 2.20 time: 0.108634 Aug 10 03:45:17.853385 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 519/1059] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:17 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 28138 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:45:17.862558 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f21a19b3-ecef-4681-a963-8673a091e75a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:17.862558 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f21a19b3-ecef-4681-a963-8673a091e75a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:17.865463 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f21a19b3-ecef-4681-a963-8673a091e75a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:17.865918 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f21a19b3-ecef-4681-a963-8673a091e75a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:17.866698 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f21a19b3-ecef-4681-a963-8673a091e75a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:17.867134 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f21a19b3-ecef-4681-a963-8673a091e75a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:17.980837 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f21a19b3-ecef-4681-a963-8673a091e75a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 28512 microversion: 2.1 time: 0.127149 Aug 10 03:45:17.983452 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 520/1060] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:17 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 28512 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:17.987230 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1f297156-0c6a-43aa-88cc-120ce12bd6d3 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de/os-volume_attachments/0d67f9de-e71a-4098-a55a-4f1c3a86b072" status: 202 len: 0 microversion: 2.1 time: 0.380479 Aug 10 03:45:17.988014 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 541/1061] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 10 03:45:17 2021] DELETE /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de/os-volume_attachments/0d67f9de-e71a-4098-a55a-4f1c3a86b072 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:17.991401 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-88d82f9b-9707-48e3-a6c2-a38c4e2b661b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:17.992320 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-88d82f9b-9707-48e3-a6c2-a38c4e2b661b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:18.003951 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-88d82f9b-9707-48e3-a6c2-a38c4e2b661b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:18.004686 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-88d82f9b-9707-48e3-a6c2-a38c4e2b661b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:18.007063 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-88d82f9b-9707-48e3-a6c2-a38c4e2b661b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:18.012377 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-88d82f9b-9707-48e3-a6c2-a38c4e2b661b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:18.143740 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-88d82f9b-9707-48e3-a6c2-a38c4e2b661b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:18.153503 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-88d82f9b-9707-48e3-a6c2-a38c4e2b661b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1757 microversion: 2.1 time: 0.166558 Aug 10 03:45:18.154071 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 521/1062] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:17 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:18.873694 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ff65bf8e-9c9f-457e-ab71-ed544b152c23 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:18.874811 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ff65bf8e-9c9f-457e-ab71-ed544b152c23 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:18.880860 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ff65bf8e-9c9f-457e-ab71-ed544b152c23 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:18.881305 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ff65bf8e-9c9f-457e-ab71-ed544b152c23 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:18.882063 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ff65bf8e-9c9f-457e-ab71-ed544b152c23 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:18.882491 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ff65bf8e-9c9f-457e-ab71-ed544b152c23 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:18.977030 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ff65bf8e-9c9f-457e-ab71-ed544b152c23 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 28138 microversion: 2.20 time: 0.108260 Aug 10 03:45:18.977600 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 542/1063] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:18 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 28138 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:18.992582 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0f705083-3246-401c-852f-9732a5c302df tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:18.993520 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0f705083-3246-401c-852f-9732a5c302df tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:19.000577 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f705083-3246-401c-852f-9732a5c302df tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:19.001027 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f705083-3246-401c-852f-9732a5c302df tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:19.001831 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f705083-3246-401c-852f-9732a5c302df tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:19.002270 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f705083-3246-401c-852f-9732a5c302df tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:19.115753 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0f705083-3246-401c-852f-9732a5c302df tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 28637 microversion: 2.1 time: 0.126637 Aug 10 03:45:19.116517 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 522/1064] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:18 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 28637 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:45:19.171704 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-4b2e449a-0c01-4fef-8374-cb0812239a0e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:19.172534 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-4b2e449a-0c01-4fef-8374-cb0812239a0e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:19.179141 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4b2e449a-0c01-4fef-8374-cb0812239a0e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:19.179489 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4b2e449a-0c01-4fef-8374-cb0812239a0e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:19.180282 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4b2e449a-0c01-4fef-8374-cb0812239a0e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:19.180705 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4b2e449a-0c01-4fef-8374-cb0812239a0e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:19.310182 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4b2e449a-0c01-4fef-8374-cb0812239a0e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:19.318324 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-4b2e449a-0c01-4fef-8374-cb0812239a0e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1757 microversion: 2.1 time: 0.150658 Aug 10 03:45:19.318972 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 543/1065] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:19 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1757 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:19.991796 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1bfce764-64df-4d75-8bcf-777b0d7b3572 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:19.992812 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1bfce764-64df-4d75-8bcf-777b0d7b3572 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:19.999294 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1bfce764-64df-4d75-8bcf-777b0d7b3572 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:19.999754 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1bfce764-64df-4d75-8bcf-777b0d7b3572 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:20.000545 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1bfce764-64df-4d75-8bcf-777b0d7b3572 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:20.000970 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1bfce764-64df-4d75-8bcf-777b0d7b3572 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:20.101824 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1bfce764-64df-4d75-8bcf-777b0d7b3572 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 28138 microversion: 2.20 time: 0.113809 Aug 10 03:45:20.106779 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 523/1066] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:19 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 28138 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:20.127945 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f8c37cfa-fa0f-4cd4-b3ab-525570799a10 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:20.128870 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f8c37cfa-fa0f-4cd4-b3ab-525570799a10 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:20.134660 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8c37cfa-fa0f-4cd4-b3ab-525570799a10 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:20.135663 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8c37cfa-fa0f-4cd4-b3ab-525570799a10 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:20.136449 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8c37cfa-fa0f-4cd4-b3ab-525570799a10 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:20.136875 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f8c37cfa-fa0f-4cd4-b3ab-525570799a10 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:20.187233 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ffd19523-2e3d-4f3b-9971-29cb71f17b24 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:20.187855 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ffd19523-2e3d-4f3b-9971-29cb71f17b24 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:20.194211 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ffd19523-2e3d-4f3b-9971-29cb71f17b24 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:20.194651 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ffd19523-2e3d-4f3b-9971-29cb71f17b24 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:20.195408 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ffd19523-2e3d-4f3b-9971-29cb71f17b24 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:20.195832 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ffd19523-2e3d-4f3b-9971-29cb71f17b24 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:20.223055 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ffd19523-2e3d-4f3b-9971-29cb71f17b24 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Going to try to terminate instance {{(pid=108440) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:45:20.242149 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f8c37cfa-fa0f-4cd4-b3ab-525570799a10 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 28680 microversion: 2.1 time: 0.117496 Aug 10 03:45:20.248548 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 544/1067] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:20 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 28680 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:20.335146 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-84e145e7-3f21-47b4-8827-a7c2140c35e9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:20.335777 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-84e145e7-3f21-47b4-8827-a7c2140c35e9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:20.342350 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84e145e7-3f21-47b4-8827-a7c2140c35e9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:20.342792 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84e145e7-3f21-47b4-8827-a7c2140c35e9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:20.343540 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84e145e7-3f21-47b4-8827-a7c2140c35e9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:20.343961 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84e145e7-3f21-47b4-8827-a7c2140c35e9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:20.499741 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-84e145e7-3f21-47b4-8827-a7c2140c35e9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:20.509463 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-84e145e7-3f21-47b4-8827-a7c2140c35e9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1757 microversion: 2.1 time: 0.178320 Aug 10 03:45:20.510564 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 545/1068] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:20 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:45:20.579578 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ffd19523-2e3d-4f3b-9971-29cb71f17b24 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 204 len: 0 microversion: 2.1 time: 0.396068 Aug 10 03:45:20.580156 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 524/1069] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:45:20 2021] DELETE /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 03:45:20.592115 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6c658e87-c08f-4bfe-accf-327bf6d263ff tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:20.592115 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6c658e87-c08f-4bfe-accf-327bf6d263ff tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:20.595504 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6c658e87-c08f-4bfe-accf-327bf6d263ff tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:20.595950 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6c658e87-c08f-4bfe-accf-327bf6d263ff tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:20.596742 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6c658e87-c08f-4bfe-accf-327bf6d263ff tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:20.597167 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6c658e87-c08f-4bfe-accf-327bf6d263ff tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:20.720917 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6c658e87-c08f-4bfe-accf-327bf6d263ff tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:20.729419 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6c658e87-c08f-4bfe-accf-327bf6d263ff tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1513 microversion: 2.1 time: 0.144064 Aug 10 03:45:20.730164 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 546/1070] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:20 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:21.115088 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-2cd3bd66-6ed2-4b1a-9289-2f9431a82a5f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:21.115865 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-2cd3bd66-6ed2-4b1a-9289-2f9431a82a5f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:21.121697 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2cd3bd66-6ed2-4b1a-9289-2f9431a82a5f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:21.122137 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2cd3bd66-6ed2-4b1a-9289-2f9431a82a5f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:21.122898 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2cd3bd66-6ed2-4b1a-9289-2f9431a82a5f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:21.123371 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2cd3bd66-6ed2-4b1a-9289-2f9431a82a5f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:21.246404 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-2cd3bd66-6ed2-4b1a-9289-2f9431a82a5f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 28429 microversion: 2.20 time: 0.135435 Aug 10 03:45:21.247043 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 525/1071] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:21 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 28429 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:21.255892 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-47b5d325-701d-468e-bcd3-6e913b8e9b0f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:21.257142 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-47b5d325-701d-468e-bcd3-6e913b8e9b0f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:21.263484 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47b5d325-701d-468e-bcd3-6e913b8e9b0f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:21.263993 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47b5d325-701d-468e-bcd3-6e913b8e9b0f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:21.264856 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47b5d325-701d-468e-bcd3-6e913b8e9b0f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:21.265351 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47b5d325-701d-468e-bcd3-6e913b8e9b0f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:21.402807 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-47b5d325-701d-468e-bcd3-6e913b8e9b0f tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 28680 microversion: 2.1 time: 0.150288 Aug 10 03:45:21.403892 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 547/1072] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:21 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 28680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:21.529444 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7c4a2fb4-a6a2-479f-8a4f-ac7d2ef78939 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:21.530137 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7c4a2fb4-a6a2-479f-8a4f-ac7d2ef78939 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:21.536583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c4a2fb4-a6a2-479f-8a4f-ac7d2ef78939 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:21.537025 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c4a2fb4-a6a2-479f-8a4f-ac7d2ef78939 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:21.537792 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c4a2fb4-a6a2-479f-8a4f-ac7d2ef78939 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:21.538220 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7c4a2fb4-a6a2-479f-8a4f-ac7d2ef78939 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:21.748240 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-47ac2e6d-9a17-4980-b86f-2fbb044ea0f4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:21.749275 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-47ac2e6d-9a17-4980-b86f-2fbb044ea0f4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:21.756013 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47ac2e6d-9a17-4980-b86f-2fbb044ea0f4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:21.756587 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47ac2e6d-9a17-4980-b86f-2fbb044ea0f4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:21.757382 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47ac2e6d-9a17-4980-b86f-2fbb044ea0f4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:21.757814 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-47ac2e6d-9a17-4980-b86f-2fbb044ea0f4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:21.763074 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7c4a2fb4-a6a2-479f-8a4f-ac7d2ef78939 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:21.771573 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7c4a2fb4-a6a2-479f-8a4f-ac7d2ef78939 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1757 microversion: 2.1 time: 0.247618 Aug 10 03:45:21.772440 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 526/1073] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:21 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1757 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:22.079222 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-47ac2e6d-9a17-4980-b86f-2fbb044ea0f4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:22.087172 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-47ac2e6d-9a17-4980-b86f-2fbb044ea0f4 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1513 microversion: 2.1 time: 0.343579 Aug 10 03:45:22.087729 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 548/1074] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:21 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1513 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:45:22.258567 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b7edce6c-b3b0-488a-bf49-fa5126372958 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:22.259373 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b7edce6c-b3b0-488a-bf49-fa5126372958 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:22.265495 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b7edce6c-b3b0-488a-bf49-fa5126372958 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:22.265937 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b7edce6c-b3b0-488a-bf49-fa5126372958 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:22.266689 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b7edce6c-b3b0-488a-bf49-fa5126372958 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:22.267145 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b7edce6c-b3b0-488a-bf49-fa5126372958 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:22.388648 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b7edce6c-b3b0-488a-bf49-fa5126372958 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 28429 microversion: 2.20 time: 0.133233 Aug 10 03:45:22.389775 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 527/1075] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:22 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 28429 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:22.415194 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-601bbf49-123c-4f4e-9f47-2d14e185da6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:22.416802 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-601bbf49-123c-4f4e-9f47-2d14e185da6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:22.422702 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-601bbf49-123c-4f4e-9f47-2d14e185da6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:22.423225 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-601bbf49-123c-4f4e-9f47-2d14e185da6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:22.424085 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-601bbf49-123c-4f4e-9f47-2d14e185da6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:22.424544 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-601bbf49-123c-4f4e-9f47-2d14e185da6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:22.574572 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-601bbf49-123c-4f4e-9f47-2d14e185da6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 28680 microversion: 2.1 time: 0.163414 Aug 10 03:45:22.575150 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 549/1076] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:22 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 28680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:22.789356 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ba660f48-76f7-468e-9c68-76bdcde8c9a9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:22.790077 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ba660f48-76f7-468e-9c68-76bdcde8c9a9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:22.797183 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ba660f48-76f7-468e-9c68-76bdcde8c9a9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:22.797627 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ba660f48-76f7-468e-9c68-76bdcde8c9a9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:22.798428 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ba660f48-76f7-468e-9c68-76bdcde8c9a9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:22.798897 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ba660f48-76f7-468e-9c68-76bdcde8c9a9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:23.008612 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ba660f48-76f7-468e-9c68-76bdcde8c9a9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:23.022800 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ba660f48-76f7-468e-9c68-76bdcde8c9a9 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1757 microversion: 2.1 time: 0.237350 Aug 10 03:45:23.024747 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 528/1077] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:22 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1757 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:23.124618 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-95ec1f7c-dcb8-42c3-82e1-d97678b4d1b0 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:23.128379 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-95ec1f7c-dcb8-42c3-82e1-d97678b4d1b0 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:23.137548 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-95ec1f7c-dcb8-42c3-82e1-d97678b4d1b0 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:23.138289 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-95ec1f7c-dcb8-42c3-82e1-d97678b4d1b0 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:23.139625 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-95ec1f7c-dcb8-42c3-82e1-d97678b4d1b0 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:23.140402 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-95ec1f7c-dcb8-42c3-82e1-d97678b4d1b0 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:23.302799 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-95ec1f7c-dcb8-42c3-82e1-d97678b4d1b0 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:23.310238 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-95ec1f7c-dcb8-42c3-82e1-d97678b4d1b0 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1513 microversion: 2.1 time: 0.208110 Aug 10 03:45:23.310804 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 550/1078] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:23 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:23.404682 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c1558dc8-51c8-4cc2-adbe-bb32497782af tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:23.408890 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c1558dc8-51c8-4cc2-adbe-bb32497782af tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:23.413388 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1558dc8-51c8-4cc2-adbe-bb32497782af tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:23.413840 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1558dc8-51c8-4cc2-adbe-bb32497782af tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:23.414623 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1558dc8-51c8-4cc2-adbe-bb32497782af tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:23.415059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1558dc8-51c8-4cc2-adbe-bb32497782af tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:23.513076 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c1558dc8-51c8-4cc2-adbe-bb32497782af tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 28597 microversion: 2.20 time: 0.115928 Aug 10 03:45:23.513769 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 529/1079] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:23 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 28597 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:45:23.586993 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-84d5c5cb-d179-4852-9528-27128a7f84f5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:23.588694 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-84d5c5cb-d179-4852-9528-27128a7f84f5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:23.596067 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84d5c5cb-d179-4852-9528-27128a7f84f5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:23.596862 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84d5c5cb-d179-4852-9528-27128a7f84f5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:23.598007 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84d5c5cb-d179-4852-9528-27128a7f84f5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:23.598513 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84d5c5cb-d179-4852-9528-27128a7f84f5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:23.696705 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-84d5c5cb-d179-4852-9528-27128a7f84f5 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 28680 microversion: 2.1 time: 0.113107 Aug 10 03:45:23.697580 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 551/1080] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:23 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 28680 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:23.755823 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-653f1731-cdfa-4cff-adee-ccee53a3de52 req-3a89e517-5669-4255-9b7c-d645126f5603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab91771-2631-4430-adf0-a39b63cfc1de", "name": "network-vif-deleted", "tag": "887ed7fa-0ce1-4a88-8da2-e406a0557f46"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:23.757825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:45:23.757825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:45:23.766322 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-653f1731-cdfa-4cff-adee-ccee53a3de52 req-3a89e517-5669-4255-9b7c-d645126f5603 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:23.766772 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-653f1731-cdfa-4cff-adee-ccee53a3de52 req-3a89e517-5669-4255-9b7c-d645126f5603 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:23.778946 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-653f1731-cdfa-4cff-adee-ccee53a3de52 req-3a89e517-5669-4255-9b7c-d645126f5603 service nova] Creating event network-vif-deleted:887ed7fa-0ce1-4a88-8da2-e406a0557f46 for instance 6ab91771-2631-4430-adf0-a39b63cfc1de on hv-cinder-78239 Aug 10 03:45:23.786749 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-653f1731-cdfa-4cff-adee-ccee53a3de52 req-3a89e517-5669-4255-9b7c-d645126f5603 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035543 Aug 10 03:45:23.787357 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 530/1081] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:45:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:45:24.051257 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-01706329-0fe1-4338-9bfc-ff8f39a5f0e5 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:24.051257 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-01706329-0fe1-4338-9bfc-ff8f39a5f0e5 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:24.055284 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-01706329-0fe1-4338-9bfc-ff8f39a5f0e5 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:24.055729 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-01706329-0fe1-4338-9bfc-ff8f39a5f0e5 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:24.056925 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-01706329-0fe1-4338-9bfc-ff8f39a5f0e5 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:24.057358 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-01706329-0fe1-4338-9bfc-ff8f39a5f0e5 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:24.208299 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-01706329-0fe1-4338-9bfc-ff8f39a5f0e5 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:24.221033 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-01706329-0fe1-4338-9bfc-ff8f39a5f0e5 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1757 microversion: 2.1 time: 0.176975 Aug 10 03:45:24.222080 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 552/1082] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:24 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:24.327411 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-169a1b99-0872-498f-9445-df61239662f5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:24.328108 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-169a1b99-0872-498f-9445-df61239662f5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:24.334209 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-169a1b99-0872-498f-9445-df61239662f5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:24.334652 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-169a1b99-0872-498f-9445-df61239662f5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:24.335423 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-169a1b99-0872-498f-9445-df61239662f5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:24.335860 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-169a1b99-0872-498f-9445-df61239662f5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:24.378640 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-169a1b99-0872-498f-9445-df61239662f5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:24.379085 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-169a1b99-0872-498f-9445-df61239662f5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:24.379542 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-169a1b99-0872-498f-9445-df61239662f5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lazy-loading 'fault' on Instance uuid 6ab91771-2631-4430-adf0-a39b63cfc1de {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:45:24.475511 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-169a1b99-0872-498f-9445-df61239662f5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2206fc1fcde4dc4bc9dd24c016c2dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce125c05e8d4cb99302437ab92ffd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:24.475511 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-169a1b99-0872-498f-9445-df61239662f5 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 200 len: 1309 microversion: 2.1 time: 0.107794 Aug 10 03:45:24.475511 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 531/1083] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:24 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:24.527955 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-84c38f0c-2956-4689-a01a-268db3c23f3d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:24.529469 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-84c38f0c-2956-4689-a01a-268db3c23f3d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:24.539474 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84c38f0c-2956-4689-a01a-268db3c23f3d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:24.540667 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84c38f0c-2956-4689-a01a-268db3c23f3d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:24.542145 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84c38f0c-2956-4689-a01a-268db3c23f3d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:24.543111 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-84c38f0c-2956-4689-a01a-268db3c23f3d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:24.662176 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-84c38f0c-2956-4689-a01a-268db3c23f3d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 28597 microversion: 2.20 time: 0.140153 Aug 10 03:45:24.662806 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 553/1084] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:24 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 28597 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:24.708576 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-12ccc6bd-c2a7-450c-9987-1356f47bbcdd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:24.709553 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-12ccc6bd-c2a7-450c-9987-1356f47bbcdd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:24.715223 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-12ccc6bd-c2a7-450c-9987-1356f47bbcdd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:24.715667 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-12ccc6bd-c2a7-450c-9987-1356f47bbcdd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:24.716461 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-12ccc6bd-c2a7-450c-9987-1356f47bbcdd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:24.716894 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-12ccc6bd-c2a7-450c-9987-1356f47bbcdd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:24.815220 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-12ccc6bd-c2a7-450c-9987-1356f47bbcdd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 28799 microversion: 2.1 time: 0.110203 Aug 10 03:45:24.819610 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 532/1085] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:24 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 28799 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:25.239212 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1d09ab47-08b4-448f-838c-ae9198d5075d tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:25.239926 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1d09ab47-08b4-448f-838c-ae9198d5075d tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:25.246585 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1d09ab47-08b4-448f-838c-ae9198d5075d tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:25.247021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1d09ab47-08b4-448f-838c-ae9198d5075d tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:25.247771 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1d09ab47-08b4-448f-838c-ae9198d5075d tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:25.248215 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1d09ab47-08b4-448f-838c-ae9198d5075d tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:25.400053 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1d09ab47-08b4-448f-838c-ae9198d5075d tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:25.408590 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1d09ab47-08b4-448f-838c-ae9198d5075d tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1757 microversion: 2.1 time: 0.173429 Aug 10 03:45:25.409168 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 554/1086] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:25 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:25.501547 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-322b0375-7357-4ba5-a5dd-008f94698d23 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:25.502296 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-322b0375-7357-4ba5-a5dd-008f94698d23 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] [instance: 6ab91771-2631-4430-adf0-a39b63cfc1de] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:25.508716 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-322b0375-7357-4ba5-a5dd-008f94698d23 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:25.509205 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-322b0375-7357-4ba5-a5dd-008f94698d23 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:25.510551 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-322b0375-7357-4ba5-a5dd-008f94698d23 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:25.510986 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-322b0375-7357-4ba5-a5dd-008f94698d23 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:25.524286 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-322b0375-7357-4ba5-a5dd-008f94698d23 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] HTTP exception thrown: Instance 6ab91771-2631-4430-adf0-a39b63cfc1de could not be found. Aug 10 03:45:25.524974 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-322b0375-7357-4ba5-a5dd-008f94698d23 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] Returning 404 to user: Instance 6ab91771-2631-4430-adf0-a39b63cfc1de could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:45:25.525793 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-322b0375-7357-4ba5-a5dd-008f94698d23 tempest-VolumesSnapshotTestJSON-1539035413 tempest-VolumesSnapshotTestJSON-1539035413-project] 10.222.0.21 "GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de" status: 404 len: 111 microversion: 2.1 time: 0.028343 Aug 10 03:45:25.526312 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 533/1087] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:25 2021] GET /compute/v2.1/servers/6ab91771-2631-4430-adf0-a39b63cfc1de => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:45:25.673809 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ea707591-c382-4af4-8e2c-d60bb485235a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:25.675597 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ea707591-c382-4af4-8e2c-d60bb485235a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:25.682091 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ea707591-c382-4af4-8e2c-d60bb485235a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:25.682497 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ea707591-c382-4af4-8e2c-d60bb485235a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:25.683269 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ea707591-c382-4af4-8e2c-d60bb485235a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:25.683703 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ea707591-c382-4af4-8e2c-d60bb485235a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:25.774480 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ea707591-c382-4af4-8e2c-d60bb485235a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 28597 microversion: 2.20 time: 0.104101 Aug 10 03:45:25.777866 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 555/1088] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:25 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 28597 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:25.829135 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-44d13dd6-d7d5-4b77-9a78-b3b8824968bd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:25.830070 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-44d13dd6-d7d5-4b77-9a78-b3b8824968bd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:25.845843 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44d13dd6-d7d5-4b77-9a78-b3b8824968bd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:25.845843 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44d13dd6-d7d5-4b77-9a78-b3b8824968bd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:25.845843 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44d13dd6-d7d5-4b77-9a78-b3b8824968bd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:25.845843 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44d13dd6-d7d5-4b77-9a78-b3b8824968bd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:26.024683 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-44d13dd6-d7d5-4b77-9a78-b3b8824968bd tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 30505 microversion: 2.1 time: 0.199033 Aug 10 03:45:26.028833 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 534/1089] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:25 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 30505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:26.425537 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d38ecd78-b7b7-42f9-aa8e-f59176a0dd3e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:26.426233 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d38ecd78-b7b7-42f9-aa8e-f59176a0dd3e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:26.432714 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d38ecd78-b7b7-42f9-aa8e-f59176a0dd3e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:26.433156 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d38ecd78-b7b7-42f9-aa8e-f59176a0dd3e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:26.433914 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d38ecd78-b7b7-42f9-aa8e-f59176a0dd3e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:26.434342 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d38ecd78-b7b7-42f9-aa8e-f59176a0dd3e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:26.557318 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d38ecd78-b7b7-42f9-aa8e-f59176a0dd3e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:26.565101 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d38ecd78-b7b7-42f9-aa8e-f59176a0dd3e tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1760 microversion: 2.1 time: 0.143689 Aug 10 03:45:26.565663 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 556/1090] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:26 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1760 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:26.786908 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-89e5a63c-4f7d-4782-ae65-1a78b6d6bf70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:26.787799 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-89e5a63c-4f7d-4782-ae65-1a78b6d6bf70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:26.794326 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-89e5a63c-4f7d-4782-ae65-1a78b6d6bf70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:26.794765 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-89e5a63c-4f7d-4782-ae65-1a78b6d6bf70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:26.795521 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-89e5a63c-4f7d-4782-ae65-1a78b6d6bf70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:26.795941 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-89e5a63c-4f7d-4782-ae65-1a78b6d6bf70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:26.888863 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-89e5a63c-4f7d-4782-ae65-1a78b6d6bf70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 28597 microversion: 2.20 time: 0.106059 Aug 10 03:45:26.889727 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 535/1091] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:26 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 28597 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:27.038385 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f61f1bad-40d3-4d7a-bf88-b5552e9e7762 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:27.039229 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f61f1bad-40d3-4d7a-bf88-b5552e9e7762 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:27.045282 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f61f1bad-40d3-4d7a-bf88-b5552e9e7762 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:27.045723 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f61f1bad-40d3-4d7a-bf88-b5552e9e7762 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:27.046514 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f61f1bad-40d3-4d7a-bf88-b5552e9e7762 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:27.046940 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f61f1bad-40d3-4d7a-bf88-b5552e9e7762 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:27.143015 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f61f1bad-40d3-4d7a-bf88-b5552e9e7762 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 32310 microversion: 2.1 time: 0.109030 Aug 10 03:45:27.145596 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 557/1092] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:27 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 32310 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:27.901490 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d0acee6c-28bc-4274-b58b-af1d88024f3d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:27.903414 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d0acee6c-28bc-4274-b58b-af1d88024f3d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:27.910545 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d0acee6c-28bc-4274-b58b-af1d88024f3d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:27.911294 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d0acee6c-28bc-4274-b58b-af1d88024f3d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:27.912117 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d0acee6c-28bc-4274-b58b-af1d88024f3d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:27.912782 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d0acee6c-28bc-4274-b58b-af1d88024f3d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:28.007227 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d0acee6c-28bc-4274-b58b-af1d88024f3d tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 29785 microversion: 2.20 time: 0.109867 Aug 10 03:45:28.007882 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 536/1093] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:27 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 29785 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:28.157370 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b39e1d55-e607-414f-8b59-cc861a916924 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:28.159150 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b39e1d55-e607-414f-8b59-cc861a916924 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:28.166889 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b39e1d55-e607-414f-8b59-cc861a916924 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:28.167473 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b39e1d55-e607-414f-8b59-cc861a916924 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:28.168416 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b39e1d55-e607-414f-8b59-cc861a916924 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:28.169154 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b39e1d55-e607-414f-8b59-cc861a916924 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:28.277553 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b39e1d55-e607-414f-8b59-cc861a916924 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 33323 microversion: 2.1 time: 0.125132 Aug 10 03:45:28.277821 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 558/1094] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:28 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 33323 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:29.023587 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-aa562d49-81b7-49fb-a70a-5e90e23fb4b2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:29.026829 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-aa562d49-81b7-49fb-a70a-5e90e23fb4b2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:29.037642 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aa562d49-81b7-49fb-a70a-5e90e23fb4b2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:29.038413 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aa562d49-81b7-49fb-a70a-5e90e23fb4b2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:29.039749 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aa562d49-81b7-49fb-a70a-5e90e23fb4b2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:29.040546 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aa562d49-81b7-49fb-a70a-5e90e23fb4b2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:29.289443 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-11b5a666-d2ce-426c-9bec-40b77230566a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:29.290694 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-11b5a666-d2ce-426c-9bec-40b77230566a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:29.297378 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-11b5a666-d2ce-426c-9bec-40b77230566a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:29.297896 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-11b5a666-d2ce-426c-9bec-40b77230566a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:29.298845 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-11b5a666-d2ce-426c-9bec-40b77230566a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:29.299337 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-11b5a666-d2ce-426c-9bec-40b77230566a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:31.290833 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-aa562d49-81b7-49fb-a70a-5e90e23fb4b2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 33586 microversion: 2.20 time: 2.273573 Aug 10 03:45:31.293617 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 537/1095] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:29 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 33586 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:31.316749 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-11b5a666-d2ce-426c-9bec-40b77230566a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 36569 microversion: 2.1 time: 2.030622 Aug 10 03:45:31.319673 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 559/1096] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:29 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 36569 bytes in 2033 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:45:32.304982 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-35a64790-c3e4-456d-b4ba-cda530f24e0b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:32.306688 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-35a64790-c3e4-456d-b4ba-cda530f24e0b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:32.313489 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-35a64790-c3e4-456d-b4ba-cda530f24e0b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:32.313942 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-35a64790-c3e4-456d-b4ba-cda530f24e0b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:32.314804 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-35a64790-c3e4-456d-b4ba-cda530f24e0b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:32.315430 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-35a64790-c3e4-456d-b4ba-cda530f24e0b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:32.329232 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9f08e37f-19c9-406e-b1ac-35e562434dca tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:32.330901 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9f08e37f-19c9-406e-b1ac-35e562434dca tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:32.347754 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9f08e37f-19c9-406e-b1ac-35e562434dca tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:32.348304 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9f08e37f-19c9-406e-b1ac-35e562434dca tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:32.349164 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9f08e37f-19c9-406e-b1ac-35e562434dca tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:32.349963 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9f08e37f-19c9-406e-b1ac-35e562434dca tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:32.474072 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-35a64790-c3e4-456d-b4ba-cda530f24e0b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 34809 microversion: 2.20 time: 0.172586 Aug 10 03:45:32.486303 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 538/1097] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:32 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 34809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:32.489964 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9f08e37f-19c9-406e-b1ac-35e562434dca tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 37745 microversion: 2.1 time: 0.164185 Aug 10 03:45:32.494882 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 560/1098] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:32 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 37745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:33.500302 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-385bd4cc-0249-4fa8-ba5c-8a5982c48618 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:33.507206 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-385bd4cc-0249-4fa8-ba5c-8a5982c48618 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:33.507351 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1a336568-8945-4ddf-9c72-e33f0d7c9e96 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:33.507351 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1a336568-8945-4ddf-9c72-e33f0d7c9e96 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:33.509504 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-385bd4cc-0249-4fa8-ba5c-8a5982c48618 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:33.509999 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-385bd4cc-0249-4fa8-ba5c-8a5982c48618 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:33.510813 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-385bd4cc-0249-4fa8-ba5c-8a5982c48618 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:33.511241 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-385bd4cc-0249-4fa8-ba5c-8a5982c48618 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:33.511914 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1a336568-8945-4ddf-9c72-e33f0d7c9e96 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:33.512402 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1a336568-8945-4ddf-9c72-e33f0d7c9e96 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:33.513164 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1a336568-8945-4ddf-9c72-e33f0d7c9e96 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:33.513589 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1a336568-8945-4ddf-9c72-e33f0d7c9e96 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:33.621096 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-385bd4cc-0249-4fa8-ba5c-8a5982c48618 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 35953 microversion: 2.20 time: 0.124891 Aug 10 03:45:33.621738 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 539/1099] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:33 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 35953 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:45:33.664534 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1a336568-8945-4ddf-9c72-e33f0d7c9e96 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 38207 microversion: 2.1 time: 0.165662 Aug 10 03:45:33.667593 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 561/1100] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:33 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 38207 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:34.633835 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1a92b1e0-ee89-461f-b48f-6c2eec1c6c41 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:34.634755 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1a92b1e0-ee89-461f-b48f-6c2eec1c6c41 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:34.641774 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1a92b1e0-ee89-461f-b48f-6c2eec1c6c41 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:34.642216 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1a92b1e0-ee89-461f-b48f-6c2eec1c6c41 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:34.643002 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1a92b1e0-ee89-461f-b48f-6c2eec1c6c41 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:34.643435 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1a92b1e0-ee89-461f-b48f-6c2eec1c6c41 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:34.680867 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b1fadc5d-7b51-49ff-a615-3ba463092e49 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:34.681925 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b1fadc5d-7b51-49ff-a615-3ba463092e49 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:34.696988 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b1fadc5d-7b51-49ff-a615-3ba463092e49 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:34.697448 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b1fadc5d-7b51-49ff-a615-3ba463092e49 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:34.698407 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b1fadc5d-7b51-49ff-a615-3ba463092e49 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:34.698707 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b1fadc5d-7b51-49ff-a615-3ba463092e49 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:34.758694 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1a92b1e0-ee89-461f-b48f-6c2eec1c6c41 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 37322 microversion: 2.20 time: 0.128852 Aug 10 03:45:34.759835 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 540/1101] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:34 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 37322 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:34.829099 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b1fadc5d-7b51-49ff-a615-3ba463092e49 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 38207 microversion: 2.1 time: 0.153409 Aug 10 03:45:34.830412 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 562/1102] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:34 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 38207 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:35.771262 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-71bc2998-4e49-4f72-a4b7-7ae27910a50a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:35.772457 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-71bc2998-4e49-4f72-a4b7-7ae27910a50a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:35.779752 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-71bc2998-4e49-4f72-a4b7-7ae27910a50a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:35.780220 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-71bc2998-4e49-4f72-a4b7-7ae27910a50a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:35.781146 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-71bc2998-4e49-4f72-a4b7-7ae27910a50a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:35.781758 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-71bc2998-4e49-4f72-a4b7-7ae27910a50a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:35.844128 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a1b2e438-b874-4aad-9ea6-eb077f97706d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:35.849656 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a1b2e438-b874-4aad-9ea6-eb077f97706d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:35.853240 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a1b2e438-b874-4aad-9ea6-eb077f97706d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:35.854025 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a1b2e438-b874-4aad-9ea6-eb077f97706d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:35.854981 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a1b2e438-b874-4aad-9ea6-eb077f97706d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:35.855587 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a1b2e438-b874-4aad-9ea6-eb077f97706d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:35.887305 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-71bc2998-4e49-4f72-a4b7-7ae27910a50a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 38152 microversion: 2.20 time: 0.119967 Aug 10 03:45:35.889942 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 541/1103] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:35 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 38152 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:45:35.953882 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a1b2e438-b874-4aad-9ea6-eb077f97706d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 38207 microversion: 2.1 time: 0.115549 Aug 10 03:45:35.955390 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 563/1104] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:35 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 38207 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:45:36.901181 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0da1dce9-3f49-44f8-a3ad-4d746f558b0f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:36.903385 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0da1dce9-3f49-44f8-a3ad-4d746f558b0f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:36.912070 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0da1dce9-3f49-44f8-a3ad-4d746f558b0f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:36.912616 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0da1dce9-3f49-44f8-a3ad-4d746f558b0f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:36.913660 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0da1dce9-3f49-44f8-a3ad-4d746f558b0f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:36.914251 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0da1dce9-3f49-44f8-a3ad-4d746f558b0f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:36.967881 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3ffb50d2-7851-4a6a-bd4e-08209cf0a0ae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:36.970292 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3ffb50d2-7851-4a6a-bd4e-08209cf0a0ae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:36.978989 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3ffb50d2-7851-4a6a-bd4e-08209cf0a0ae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:36.979492 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3ffb50d2-7851-4a6a-bd4e-08209cf0a0ae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:36.980369 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3ffb50d2-7851-4a6a-bd4e-08209cf0a0ae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:36.980796 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3ffb50d2-7851-4a6a-bd4e-08209cf0a0ae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:37.002736 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0da1dce9-3f49-44f8-a3ad-4d746f558b0f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 38152 microversion: 2.20 time: 0.106345 Aug 10 03:45:37.003870 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 542/1105] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:36 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 38152 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:37.084903 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3ffb50d2-7851-4a6a-bd4e-08209cf0a0ae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action" status: 200 len: 38336 microversion: 2.1 time: 0.121799 Aug 10 03:45:37.085859 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 564/1106] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:36 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/action => generated 38336 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 03:45:37.099729 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0dbce41c-e8a3-45f7-b4f8-6c097f88d21e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:37.100738 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0dbce41c-e8a3-45f7-b4f8-6c097f88d21e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:37.108788 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0dbce41c-e8a3-45f7-b4f8-6c097f88d21e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:37.109229 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0dbce41c-e8a3-45f7-b4f8-6c097f88d21e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:37.110008 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0dbce41c-e8a3-45f7-b4f8-6c097f88d21e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:37.110436 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0dbce41c-e8a3-45f7-b4f8-6c097f88d21e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:37.138079 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0dbce41c-e8a3-45f7-b4f8-6c097f88d21e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/ips" status: 200 len: 144 microversion: 2.1 time: 0.043658 Aug 10 03:45:37.144813 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 543/1107] 10.222.0.21 () {58 vars in 1248 bytes} [Tue Aug 10 03:45:37 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/ips => generated 144 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:45:38.016723 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-11a3288f-051e-43f7-ad5c-0e0be37abf58 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:38.018287 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-11a3288f-051e-43f7-ad5c-0e0be37abf58 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:38.041635 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-11a3288f-051e-43f7-ad5c-0e0be37abf58 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:38.042078 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-11a3288f-051e-43f7-ad5c-0e0be37abf58 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:38.042857 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-11a3288f-051e-43f7-ad5c-0e0be37abf58 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:38.043485 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-11a3288f-051e-43f7-ad5c-0e0be37abf58 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:38.157437 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-11a3288f-051e-43f7-ad5c-0e0be37abf58 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 38152 microversion: 2.20 time: 0.144737 Aug 10 03:45:38.159860 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 565/1108] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:38 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 38152 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:38.187653 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f0028bcd-0ccf-483c-9a6c-0cc59f2ff85b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:38.191674 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f0028bcd-0ccf-483c-9a6c-0cc59f2ff85b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:38.198035 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f0028bcd-0ccf-483c-9a6c-0cc59f2ff85b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:38.198721 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f0028bcd-0ccf-483c-9a6c-0cc59f2ff85b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:38.199710 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f0028bcd-0ccf-483c-9a6c-0cc59f2ff85b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:38.200145 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f0028bcd-0ccf-483c-9a6c-0cc59f2ff85b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:38.224575 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-f0028bcd-0ccf-483c-9a6c-0cc59f2ff85b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lazy-loading 'flavor' on Instance uuid 43a89090-7d79-496b-878d-213d6f48b970 {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:45:38.808778 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f0028bcd-0ccf-483c-9a6c-0cc59f2ff85b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "POST /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970/action" status: 202 len: 0 microversion: 2.1 time: 0.624029 Aug 10 03:45:38.810724 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 544/1109] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:45:38 2021] POST /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970/action => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:45:38.827139 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0212258a-bed3-4fd3-88a5-9b5bc5e6d7f0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:38.828599 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0212258a-bed3-4fd3-88a5-9b5bc5e6d7f0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:38.851803 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0212258a-bed3-4fd3-88a5-9b5bc5e6d7f0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:38.851803 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0212258a-bed3-4fd3-88a5-9b5bc5e6d7f0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:38.851803 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0212258a-bed3-4fd3-88a5-9b5bc5e6d7f0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:38.851803 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0212258a-bed3-4fd3-88a5-9b5bc5e6d7f0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:39.028062 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0212258a-bed3-4fd3-88a5-9b5bc5e6d7f0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:39.038480 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0212258a-bed3-4fd3-88a5-9b5bc5e6d7f0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.221548 Aug 10 03:45:39.038480 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 566/1110] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:38 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:39.171461 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-730977db-6f8f-4705-9b7f-ce2f1f4543a9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:39.172588 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-730977db-6f8f-4705-9b7f-ce2f1f4543a9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:39.178699 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-9d788df7-21ea-40c4-89b3-bb92bef0b1fd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Action: 'create', calling method: .version_select at 0x7f97a01b4820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1043484335"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:39.181426 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-730977db-6f8f-4705-9b7f-ce2f1f4543a9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:39.181874 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-730977db-6f8f-4705-9b7f-ce2f1f4543a9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:39.182650 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-730977db-6f8f-4705-9b7f-ce2f1f4543a9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:39.183069 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-730977db-6f8f-4705-9b7f-ce2f1f4543a9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:39.203371 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-9d788df7-21ea-40c4-89b3-bb92bef0b1fd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Getting quotas for project 640c843532144cd4ac804d005116e62c. Resources: {'key_pairs'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:45:39.213873 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-9d788df7-21ea-40c4-89b3-bb92bef0b1fd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Getting quotas for user 8b443000b4ae4082ac0da4f090ede3b7 and project 640c843532144cd4ac804d005116e62c. Resources: {'key_pairs'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:45:39.473173 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-9d788df7-21ea-40c4-89b3-bb92bef0b1fd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Getting quotas for project 640c843532144cd4ac804d005116e62c. Resources: {'key_pairs'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:45:39.476659 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-9d788df7-21ea-40c4-89b3-bb92bef0b1fd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Getting quotas for user 8b443000b4ae4082ac0da4f090ede3b7 and project 640c843532144cd4ac804d005116e62c. Resources: {'key_pairs'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:45:39.489288 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-9d788df7-21ea-40c4-89b3-bb92bef0b1fd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.561293 Aug 10 03:45:39.489878 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 545/1111] 10.222.0.21 () {60 vars in 1158 bytes} [Tue Aug 10 03:45:38 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:40.062596 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b546e868-3233-4247-8541-fb8590d3ca14 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:40.063551 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b546e868-3233-4247-8541-fb8590d3ca14 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:40.070210 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b546e868-3233-4247-8541-fb8590d3ca14 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:40.070651 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b546e868-3233-4247-8541-fb8590d3ca14 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:40.071427 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b546e868-3233-4247-8541-fb8590d3ca14 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:40.076711 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b546e868-3233-4247-8541-fb8590d3ca14 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:40.222541 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b546e868-3233-4247-8541-fb8590d3ca14 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:40.229955 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b546e868-3233-4247-8541-fb8590d3ca14 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.171283 Aug 10 03:45:40.240734 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 546/1112] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:40 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:45:41.258126 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-88251660-9f03-4adb-8258-901f00f2191f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:41.259235 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-88251660-9f03-4adb-8258-901f00f2191f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:41.269728 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-88251660-9f03-4adb-8258-901f00f2191f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:41.270773 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-88251660-9f03-4adb-8258-901f00f2191f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:41.272422 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-88251660-9f03-4adb-8258-901f00f2191f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:41.273205 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-88251660-9f03-4adb-8258-901f00f2191f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:41.310216 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-730977db-6f8f-4705-9b7f-ce2f1f4543a9 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 200 len: 38295 microversion: 2.20 time: 2.135541 Aug 10 03:45:41.311434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 567/1113] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:39 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 38295 bytes in 2145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:45:41.318325 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9241fdf0-f9c5-4e04-b6ff-caf74b2d8c08 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:41.319605 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9241fdf0-f9c5-4e04-b6ff-caf74b2d8c08 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:41.328031 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9241fdf0-f9c5-4e04-b6ff-caf74b2d8c08 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:41.328733 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9241fdf0-f9c5-4e04-b6ff-caf74b2d8c08 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:41.329788 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9241fdf0-f9c5-4e04-b6ff-caf74b2d8c08 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:41.330434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9241fdf0-f9c5-4e04-b6ff-caf74b2d8c08 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:41.360499 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9241fdf0-f9c5-4e04-b6ff-caf74b2d8c08 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/ips" status: 200 len: 152 microversion: 2.20 time: 0.046688 Aug 10 03:45:41.361442 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 568/1114] 10.222.0.21 () {60 vars in 1289 bytes} [Tue Aug 10 03:45:41 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:45:41.553130 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-88251660-9f03-4adb-8258-901f00f2191f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:41.561479 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-88251660-9f03-4adb-8258-901f00f2191f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.310180 Aug 10 03:45:41.562042 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 547/1115] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:41 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:45:42.503536 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6af1f5b4-688e-4fc1-b56e-3523e0c744a3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c3b356a-e961-4b89-af20-34a25c165afe"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:42.505317 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6af1f5b4-688e-4fc1-b56e-3523e0c744a3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:42.512704 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6af1f5b4-688e-4fc1-b56e-3523e0c744a3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:42.513265 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6af1f5b4-688e-4fc1-b56e-3523e0c744a3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:42.514261 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6af1f5b4-688e-4fc1-b56e-3523e0c744a3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:42.514697 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6af1f5b4-688e-4fc1-b56e-3523e0c744a3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:42.579569 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a9fca230-1245-4cb5-9f17-1d57f41b7ebe tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:42.580265 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a9fca230-1245-4cb5-9f17-1d57f41b7ebe tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:42.588520 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a9fca230-1245-4cb5-9f17-1d57f41b7ebe tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:42.592453 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a9fca230-1245-4cb5-9f17-1d57f41b7ebe tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:42.594455 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a9fca230-1245-4cb5-9f17-1d57f41b7ebe tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:42.596883 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a9fca230-1245-4cb5-9f17-1d57f41b7ebe tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:42.783773 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a9fca230-1245-4cb5-9f17-1d57f41b7ebe tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:42.795506 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a9fca230-1245-4cb5-9f17-1d57f41b7ebe tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.220148 Aug 10 03:45:42.795854 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 548/1116] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:42 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:45:43.812055 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-95f20b47-f22e-4239-ab0b-ba9e50e4d55c tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:43.812829 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-95f20b47-f22e-4239-ab0b-ba9e50e4d55c tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:43.818831 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-95f20b47-f22e-4239-ab0b-ba9e50e4d55c tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:43.819274 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-95f20b47-f22e-4239-ab0b-ba9e50e4d55c tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:43.820037 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-95f20b47-f22e-4239-ab0b-ba9e50e4d55c tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:43.820505 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-95f20b47-f22e-4239-ab0b-ba9e50e4d55c tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:43.928388 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6af1f5b4-688e-4fc1-b56e-3523e0c744a3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.428410 Aug 10 03:45:43.929911 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 569/1117] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 10 03:45:42 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments => generated 194 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:45:43.957075 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-95f20b47-f22e-4239-ab0b-ba9e50e4d55c tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:43.967833 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-95f20b47-f22e-4239-ab0b-ba9e50e4d55c tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.159268 Aug 10 03:45:43.978955 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 549/1118] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:43 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:45:44.632279 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-96ea49a7-bf89-4168-800c-3177f14b48f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:44.632969 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-96ea49a7-bf89-4168-800c-3177f14b48f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:44.639449 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-96ea49a7-bf89-4168-800c-3177f14b48f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:44.639890 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-96ea49a7-bf89-4168-800c-3177f14b48f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:44.640683 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-96ea49a7-bf89-4168-800c-3177f14b48f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:44.641114 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-96ea49a7-bf89-4168-800c-3177f14b48f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:44.668176 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-96ea49a7-bf89-4168-800c-3177f14b48f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lazy-loading 'flavor' on Instance uuid 5c37790e-ad20-4784-b0f0-20babcf19223 {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:45:44.988892 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e247d01b-95cd-4859-8e6b-b34a0c076368 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:44.989663 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e247d01b-95cd-4859-8e6b-b34a0c076368 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:44.996633 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e247d01b-95cd-4859-8e6b-b34a0c076368 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:44.997084 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e247d01b-95cd-4859-8e6b-b34a0c076368 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:44.997867 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e247d01b-95cd-4859-8e6b-b34a0c076368 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:44.998302 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e247d01b-95cd-4859-8e6b-b34a0c076368 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:45.187252 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e247d01b-95cd-4859-8e6b-b34a0c076368 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:45.199144 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e247d01b-95cd-4859-8e6b-b34a0c076368 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.213916 Aug 10 03:45:45.200108 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 550/1119] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:44 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:45:45.543240 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-96ea49a7-bf89-4168-800c-3177f14b48f6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 202 len: 0 microversion: 2.20 time: 0.914960 Aug 10 03:45:45.543921 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 570/1120] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:45:44 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 0 bytes in 917 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 03:45:45.559905 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1244e208-ab47-499f-a174-daedfcd84158 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:45.561026 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1244e208-ab47-499f-a174-daedfcd84158 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:45.568623 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1244e208-ab47-499f-a174-daedfcd84158 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:45.569063 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1244e208-ab47-499f-a174-daedfcd84158 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:45.569854 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1244e208-ab47-499f-a174-daedfcd84158 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:45.570281 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1244e208-ab47-499f-a174-daedfcd84158 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:45.709609 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1244e208-ab47-499f-a174-daedfcd84158 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:45.718546 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1244e208-ab47-499f-a174-daedfcd84158 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:45.720111 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-1244e208-ab47-499f-a174-daedfcd84158 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:45.723077 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1244e208-ab47-499f-a174-daedfcd84158 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.172497 Aug 10 03:45:45.723077 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 551/1121] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:45:45 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:45:46.219605 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-12936845-83a9-4514-86a4-4a10b311e7e3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:46.220337 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-12936845-83a9-4514-86a4-4a10b311e7e3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:46.231581 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-12936845-83a9-4514-86a4-4a10b311e7e3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:46.233513 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-12936845-83a9-4514-86a4-4a10b311e7e3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:46.234647 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-12936845-83a9-4514-86a4-4a10b311e7e3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:46.236942 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-12936845-83a9-4514-86a4-4a10b311e7e3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:46.385367 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-12936845-83a9-4514-86a4-4a10b311e7e3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:46.392879 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-12936845-83a9-4514-86a4-4a10b311e7e3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.178245 Aug 10 03:45:46.393451 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 571/1122] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:46 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:46.741037 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e778d378-bed0-4a95-b8f7-6ea06cf150e1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:46.741646 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e778d378-bed0-4a95-b8f7-6ea06cf150e1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:46.748567 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e778d378-bed0-4a95-b8f7-6ea06cf150e1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:46.749145 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e778d378-bed0-4a95-b8f7-6ea06cf150e1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:46.750034 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e778d378-bed0-4a95-b8f7-6ea06cf150e1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:46.750466 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e778d378-bed0-4a95-b8f7-6ea06cf150e1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:46.877189 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e778d378-bed0-4a95-b8f7-6ea06cf150e1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:46.886660 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e778d378-bed0-4a95-b8f7-6ea06cf150e1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:46.888176 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e778d378-bed0-4a95-b8f7-6ea06cf150e1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:46.889358 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e778d378-bed0-4a95-b8f7-6ea06cf150e1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.152160 Aug 10 03:45:46.889930 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 552/1123] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:45:46 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:45:47.410368 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-99904688-bab8-460f-b473-6529e3dcf55b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:47.411116 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-99904688-bab8-460f-b473-6529e3dcf55b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:47.417015 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-99904688-bab8-460f-b473-6529e3dcf55b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:47.417456 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-99904688-bab8-460f-b473-6529e3dcf55b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:47.418211 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-99904688-bab8-460f-b473-6529e3dcf55b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:47.418633 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-99904688-bab8-460f-b473-6529e3dcf55b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:47.551917 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-99904688-bab8-460f-b473-6529e3dcf55b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:47.560128 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-99904688-bab8-460f-b473-6529e3dcf55b tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.153369 Aug 10 03:45:47.560736 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 572/1124] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:47 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:47.909226 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-2d978378-7f83-4199-9092-cd326245fe39 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:47.910020 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-2d978378-7f83-4199-9092-cd326245fe39 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:47.917304 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2d978378-7f83-4199-9092-cd326245fe39 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:47.917744 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2d978378-7f83-4199-9092-cd326245fe39 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:47.918813 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2d978378-7f83-4199-9092-cd326245fe39 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:47.919243 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2d978378-7f83-4199-9092-cd326245fe39 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:48.051159 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-2d978378-7f83-4199-9092-cd326245fe39 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:48.060032 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-2d978378-7f83-4199-9092-cd326245fe39 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:48.061569 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-2d978378-7f83-4199-9092-cd326245fe39 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:48.062710 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-2d978378-7f83-4199-9092-cd326245fe39 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.157863 Aug 10 03:45:48.063529 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 553/1125] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:45:47 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:45:48.576827 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-86ba1bc2-e295-4bb1-90b5-4c83ce6c3940 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:48.577499 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-86ba1bc2-e295-4bb1-90b5-4c83ce6c3940 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:48.583554 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-86ba1bc2-e295-4bb1-90b5-4c83ce6c3940 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:48.583994 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-86ba1bc2-e295-4bb1-90b5-4c83ce6c3940 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:48.584794 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-86ba1bc2-e295-4bb1-90b5-4c83ce6c3940 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:48.585225 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-86ba1bc2-e295-4bb1-90b5-4c83ce6c3940 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:48.707715 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-86ba1bc2-e295-4bb1-90b5-4c83ce6c3940 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:48.716711 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-86ba1bc2-e295-4bb1-90b5-4c83ce6c3940 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.143500 Aug 10 03:45:48.717330 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 573/1126] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:48 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:49.083530 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-fdf5b237-c583-4e49-a37e-322474627ed6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:49.084062 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-fdf5b237-c583-4e49-a37e-322474627ed6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:49.090458 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fdf5b237-c583-4e49-a37e-322474627ed6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:49.090932 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fdf5b237-c583-4e49-a37e-322474627ed6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:49.091740 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fdf5b237-c583-4e49-a37e-322474627ed6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:49.092172 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fdf5b237-c583-4e49-a37e-322474627ed6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:49.216786 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-fdf5b237-c583-4e49-a37e-322474627ed6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:49.226746 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-fdf5b237-c583-4e49-a37e-322474627ed6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:49.228776 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-fdf5b237-c583-4e49-a37e-322474627ed6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:49.229938 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-fdf5b237-c583-4e49-a37e-322474627ed6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.150257 Aug 10 03:45:49.230492 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 554/1127] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:45:49 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:45:49.739870 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-da675b0a-f468-4c7c-b8bb-8d95067599b9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:49.740768 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-da675b0a-f468-4c7c-b8bb-8d95067599b9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:49.746751 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-da675b0a-f468-4c7c-b8bb-8d95067599b9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:49.747200 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-da675b0a-f468-4c7c-b8bb-8d95067599b9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:49.747970 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-da675b0a-f468-4c7c-b8bb-8d95067599b9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:49.748434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-da675b0a-f468-4c7c-b8bb-8d95067599b9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:49.879483 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-da675b0a-f468-4c7c-b8bb-8d95067599b9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:49.890540 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-da675b0a-f468-4c7c-b8bb-8d95067599b9 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.155213 Aug 10 03:45:49.891478 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 574/1128] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:49 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:50.250113 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b7a0c3d5-f9a5-4a19-ad3c-92a4f3c0b56a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:50.250775 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b7a0c3d5-f9a5-4a19-ad3c-92a4f3c0b56a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:50.258629 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b7a0c3d5-f9a5-4a19-ad3c-92a4f3c0b56a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:50.259177 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b7a0c3d5-f9a5-4a19-ad3c-92a4f3c0b56a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:50.260869 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b7a0c3d5-f9a5-4a19-ad3c-92a4f3c0b56a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:50.261371 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b7a0c3d5-f9a5-4a19-ad3c-92a4f3c0b56a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:50.390375 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b7a0c3d5-f9a5-4a19-ad3c-92a4f3c0b56a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:50.399659 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b7a0c3d5-f9a5-4a19-ad3c-92a4f3c0b56a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:50.401498 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b7a0c3d5-f9a5-4a19-ad3c-92a4f3c0b56a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:50.402703 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b7a0c3d5-f9a5-4a19-ad3c-92a4f3c0b56a tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.156954 Aug 10 03:45:50.403260 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 555/1129] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:45:50 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:45:50.908663 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e8cebb19-9bb4-4566-b3d6-3716debdd011 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:50.909274 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e8cebb19-9bb4-4566-b3d6-3716debdd011 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:50.915706 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e8cebb19-9bb4-4566-b3d6-3716debdd011 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:50.916143 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e8cebb19-9bb4-4566-b3d6-3716debdd011 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:50.916937 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e8cebb19-9bb4-4566-b3d6-3716debdd011 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:50.917357 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e8cebb19-9bb4-4566-b3d6-3716debdd011 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:51.042149 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e8cebb19-9bb4-4566-b3d6-3716debdd011 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:51.049840 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e8cebb19-9bb4-4566-b3d6-3716debdd011 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.144899 Aug 10 03:45:51.050450 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 575/1130] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:50 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:51.421108 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c98fb7bb-cd90-441f-a651-a5aef2d54abf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:51.421751 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c98fb7bb-cd90-441f-a651-a5aef2d54abf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:51.429058 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c98fb7bb-cd90-441f-a651-a5aef2d54abf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:51.429498 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c98fb7bb-cd90-441f-a651-a5aef2d54abf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:51.430548 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c98fb7bb-cd90-441f-a651-a5aef2d54abf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:51.432098 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c98fb7bb-cd90-441f-a651-a5aef2d54abf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:51.590126 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c98fb7bb-cd90-441f-a651-a5aef2d54abf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:51.599013 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c98fb7bb-cd90-441f-a651-a5aef2d54abf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:51.600522 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c98fb7bb-cd90-441f-a651-a5aef2d54abf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:51.604418 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c98fb7bb-cd90-441f-a651-a5aef2d54abf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.184361 Aug 10 03:45:51.604418 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 556/1131] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:45:51 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:45:52.067229 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a32fae19-01bd-45dc-bd28-3de8022460e1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:52.067918 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a32fae19-01bd-45dc-bd28-3de8022460e1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:52.073813 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a32fae19-01bd-45dc-bd28-3de8022460e1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:52.074257 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a32fae19-01bd-45dc-bd28-3de8022460e1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:52.075074 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a32fae19-01bd-45dc-bd28-3de8022460e1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:52.075873 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a32fae19-01bd-45dc-bd28-3de8022460e1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:52.217335 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a32fae19-01bd-45dc-bd28-3de8022460e1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:52.226094 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a32fae19-01bd-45dc-bd28-3de8022460e1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.162992 Aug 10 03:45:52.226684 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 576/1132] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:52 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:52.624503 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ef2a3662-cdf4-432f-9272-664ebfbab46c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:52.625706 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ef2a3662-cdf4-432f-9272-664ebfbab46c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:52.635342 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ef2a3662-cdf4-432f-9272-664ebfbab46c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:52.636119 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ef2a3662-cdf4-432f-9272-664ebfbab46c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:52.637538 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ef2a3662-cdf4-432f-9272-664ebfbab46c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:52.638311 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ef2a3662-cdf4-432f-9272-664ebfbab46c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:52.738788 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-af3791e7-4e65-4c44-8e2f-3f8b1a466622 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:52.742630 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-af3791e7-4e65-4c44-8e2f-3f8b1a466622 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:52.751157 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-af3791e7-4e65-4c44-8e2f-3f8b1a466622 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:52.751323 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-af3791e7-4e65-4c44-8e2f-3f8b1a466622 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:52.753001 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-af3791e7-4e65-4c44-8e2f-3f8b1a466622 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:52.753972 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-af3791e7-4e65-4c44-8e2f-3f8b1a466622 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:52.799990 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ef2a3662-cdf4-432f-9272-664ebfbab46c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:52.808499 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ef2a3662-cdf4-432f-9272-664ebfbab46c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:52.809917 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-af3791e7-4e65-4c44-8e2f-3f8b1a466622 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078227 Aug 10 03:45:52.810090 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ef2a3662-cdf4-432f-9272-664ebfbab46c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:52.810865 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 577/1133] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:45:52 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:45:52.811686 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ef2a3662-cdf4-432f-9272-664ebfbab46c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.194062 Aug 10 03:45:52.812240 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 557/1134] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:45:52 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:45:52.830082 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d81c8f6c-7657-477f-b73f-c7d770ede893 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:52.830082 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d81c8f6c-7657-477f-b73f-c7d770ede893 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:52.835491 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d81c8f6c-7657-477f-b73f-c7d770ede893 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:52.836255 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d81c8f6c-7657-477f-b73f-c7d770ede893 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:52.837166 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d81c8f6c-7657-477f-b73f-c7d770ede893 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:52.838172 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d81c8f6c-7657-477f-b73f-c7d770ede893 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:52.867302 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d81c8f6c-7657-477f-b73f-c7d770ede893 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments/8c3b356a-e961-4b89-af20-34a25c165afe" status: 200 len: 194 microversion: 2.1 time: 0.047046 Aug 10 03:45:52.867883 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 578/1135] 10.222.0.21 () {58 vars in 1413 bytes} [Tue Aug 10 03:45:52 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments/8c3b356a-e961-4b89-af20-34a25c165afe => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:45:53.245286 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a17eceea-0c4e-4a2e-a404-d40f99a22180 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:53.245883 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a17eceea-0c4e-4a2e-a404-d40f99a22180 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:53.252149 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a17eceea-0c4e-4a2e-a404-d40f99a22180 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:53.252639 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a17eceea-0c4e-4a2e-a404-d40f99a22180 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:53.253583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a17eceea-0c4e-4a2e-a404-d40f99a22180 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:53.253924 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a17eceea-0c4e-4a2e-a404-d40f99a22180 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:53.396318 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a17eceea-0c4e-4a2e-a404-d40f99a22180 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:53.402105 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a17eceea-0c4e-4a2e-a404-d40f99a22180 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.161122 Aug 10 03:45:53.402976 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 558/1136] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:53 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:45:53.830456 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-67034566-0e23-4a03-a1ab-e80d9ae1bf80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:53.831120 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-67034566-0e23-4a03-a1ab-e80d9ae1bf80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:53.837190 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-67034566-0e23-4a03-a1ab-e80d9ae1bf80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:53.838321 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-67034566-0e23-4a03-a1ab-e80d9ae1bf80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:53.839103 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-67034566-0e23-4a03-a1ab-e80d9ae1bf80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:53.839533 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-67034566-0e23-4a03-a1ab-e80d9ae1bf80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:53.977191 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-67034566-0e23-4a03-a1ab-e80d9ae1bf80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:53.986744 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-67034566-0e23-4a03-a1ab-e80d9ae1bf80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:53.988586 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-67034566-0e23-4a03-a1ab-e80d9ae1bf80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:53.989718 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-67034566-0e23-4a03-a1ab-e80d9ae1bf80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.163056 Aug 10 03:45:53.990267 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 579/1137] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:45:53 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:45:54.419197 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-346b9fec-c57b-4b10-a1be-3605637c6507 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:54.419856 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-346b9fec-c57b-4b10-a1be-3605637c6507 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:54.425788 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-346b9fec-c57b-4b10-a1be-3605637c6507 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:54.426440 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-346b9fec-c57b-4b10-a1be-3605637c6507 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:54.427232 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-346b9fec-c57b-4b10-a1be-3605637c6507 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:54.427665 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-346b9fec-c57b-4b10-a1be-3605637c6507 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:54.747932 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9251551c-04cf-42aa-8c00-95fa879d01c0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad05d8d9-38c5-4cc5-8ea7-29d128b7e76c"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:45:54.749054 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9251551c-04cf-42aa-8c00-95fa879d01c0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:54.755665 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9251551c-04cf-42aa-8c00-95fa879d01c0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:54.756102 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9251551c-04cf-42aa-8c00-95fa879d01c0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:54.757137 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9251551c-04cf-42aa-8c00-95fa879d01c0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:54.757759 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9251551c-04cf-42aa-8c00-95fa879d01c0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:54.833885 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-346b9fec-c57b-4b10-a1be-3605637c6507 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:54.844820 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-346b9fec-c57b-4b10-a1be-3605637c6507 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.429724 Aug 10 03:45:54.846034 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 559/1138] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:54 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:55.009815 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c91f559b-a679-42a0-b938-78eebea378c2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:55.010570 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c91f559b-a679-42a0-b938-78eebea378c2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:55.016648 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c91f559b-a679-42a0-b938-78eebea378c2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:55.017806 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c91f559b-a679-42a0-b938-78eebea378c2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:55.018589 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c91f559b-a679-42a0-b938-78eebea378c2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:55.019014 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c91f559b-a679-42a0-b938-78eebea378c2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:55.266032 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c91f559b-a679-42a0-b938-78eebea378c2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:55.276894 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c91f559b-a679-42a0-b938-78eebea378c2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:55.278265 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c91f559b-a679-42a0-b938-78eebea378c2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:55.279641 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c91f559b-a679-42a0-b938-78eebea378c2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.274088 Aug 10 03:45:55.280338 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 560/1139] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:45:55 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:45:55.862662 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f37ced8b-211c-487c-bffa-a792998c6519 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:55.863343 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f37ced8b-211c-487c-bffa-a792998c6519 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:55.869279 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f37ced8b-211c-487c-bffa-a792998c6519 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:55.869723 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f37ced8b-211c-487c-bffa-a792998c6519 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:55.870531 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f37ced8b-211c-487c-bffa-a792998c6519 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:55.870966 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f37ced8b-211c-487c-bffa-a792998c6519 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:55.999580 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f37ced8b-211c-487c-bffa-a792998c6519 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:56.028025 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f37ced8b-211c-487c-bffa-a792998c6519 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.155864 Aug 10 03:45:56.028025 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 561/1140] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:55 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:45:56.131002 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9251551c-04cf-42aa-8c00-95fa879d01c0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.387260 Aug 10 03:45:56.142285 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 580/1141] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 10 03:45:54 2021] POST /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments => generated 194 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:45:56.300014 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-3aecee0f-9ada-486e-8866-387bb2403e69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:56.300810 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-3aecee0f-9ada-486e-8866-387bb2403e69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:56.307792 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3aecee0f-9ada-486e-8866-387bb2403e69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:56.308290 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3aecee0f-9ada-486e-8866-387bb2403e69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:56.309035 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3aecee0f-9ada-486e-8866-387bb2403e69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:56.309459 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-3aecee0f-9ada-486e-8866-387bb2403e69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:56.471512 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3aecee0f-9ada-486e-8866-387bb2403e69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:56.479962 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3aecee0f-9ada-486e-8866-387bb2403e69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:56.482138 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-3aecee0f-9ada-486e-8866-387bb2403e69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:56.483992 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-3aecee0f-9ada-486e-8866-387bb2403e69 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.188338 Aug 10 03:45:56.485068 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 562/1142] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:45:56 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:45:57.040918 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-34c741d9-3c28-4a40-8538-b9db17b67d01 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:57.041927 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-34c741d9-3c28-4a40-8538-b9db17b67d01 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:57.054740 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-34c741d9-3c28-4a40-8538-b9db17b67d01 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:57.055451 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-34c741d9-3c28-4a40-8538-b9db17b67d01 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:57.056797 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-34c741d9-3c28-4a40-8538-b9db17b67d01 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:57.057494 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-34c741d9-3c28-4a40-8538-b9db17b67d01 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:57.228564 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-34c741d9-3c28-4a40-8538-b9db17b67d01 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:57.243142 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-34c741d9-3c28-4a40-8538-b9db17b67d01 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.208369 Aug 10 03:45:57.259104 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 581/1143] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:57 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:45:57.503436 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-6892217f-8e56-429c-8300-24ae0dd64ecc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:57.504060 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-6892217f-8e56-429c-8300-24ae0dd64ecc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:57.511117 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6892217f-8e56-429c-8300-24ae0dd64ecc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:57.511585 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6892217f-8e56-429c-8300-24ae0dd64ecc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:57.512396 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6892217f-8e56-429c-8300-24ae0dd64ecc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:57.512818 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-6892217f-8e56-429c-8300-24ae0dd64ecc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:57.646804 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6892217f-8e56-429c-8300-24ae0dd64ecc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:57.651024 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6892217f-8e56-429c-8300-24ae0dd64ecc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:57.652632 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-6892217f-8e56-429c-8300-24ae0dd64ecc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:57.653834 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-6892217f-8e56-429c-8300-24ae0dd64ecc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.154682 Aug 10 03:45:57.654509 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 563/1144] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:45:57 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:45:58.272742 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-18a10249-6518-491d-b4d0-89ce3f73cc81 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:58.273450 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-18a10249-6518-491d-b4d0-89ce3f73cc81 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:58.280714 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-18a10249-6518-491d-b4d0-89ce3f73cc81 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:58.281155 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-18a10249-6518-491d-b4d0-89ce3f73cc81 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:58.281929 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-18a10249-6518-491d-b4d0-89ce3f73cc81 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:58.282357 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-18a10249-6518-491d-b4d0-89ce3f73cc81 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:58.412752 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-18a10249-6518-491d-b4d0-89ce3f73cc81 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:58.421105 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-18a10249-6518-491d-b4d0-89ce3f73cc81 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.152254 Aug 10 03:45:58.421661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 582/1145] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:58 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:58.672441 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0cda84c5-e0d2-4198-9a91-72daff414dfb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:58.673089 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0cda84c5-e0d2-4198-9a91-72daff414dfb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:58.679387 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0cda84c5-e0d2-4198-9a91-72daff414dfb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:58.679831 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0cda84c5-e0d2-4198-9a91-72daff414dfb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:58.680677 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0cda84c5-e0d2-4198-9a91-72daff414dfb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:58.681163 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0cda84c5-e0d2-4198-9a91-72daff414dfb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:58.814103 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0cda84c5-e0d2-4198-9a91-72daff414dfb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:58.818772 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0cda84c5-e0d2-4198-9a91-72daff414dfb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:58.820293 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0cda84c5-e0d2-4198-9a91-72daff414dfb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:58.821449 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0cda84c5-e0d2-4198-9a91-72daff414dfb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.152823 Aug 10 03:45:58.822572 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 564/1146] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:45:58 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:45:59.437863 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e78c32bf-86b1-4a17-a76b-6a258c43cb05 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:59.438416 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e78c32bf-86b1-4a17-a76b-6a258c43cb05 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:59.444316 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e78c32bf-86b1-4a17-a76b-6a258c43cb05 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:59.444759 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e78c32bf-86b1-4a17-a76b-6a258c43cb05 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:59.445529 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e78c32bf-86b1-4a17-a76b-6a258c43cb05 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:59.445957 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e78c32bf-86b1-4a17-a76b-6a258c43cb05 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:59.567783 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e78c32bf-86b1-4a17-a76b-6a258c43cb05 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:45:59.575846 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e78c32bf-86b1-4a17-a76b-6a258c43cb05 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.141663 Aug 10 03:45:59.576512 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 583/1147] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:45:59 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:45:59.840271 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c5562a9c-047d-4319-908f-adc6538f19f0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:45:59.840889 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c5562a9c-047d-4319-908f-adc6538f19f0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:45:59.846724 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c5562a9c-047d-4319-908f-adc6538f19f0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:59.847158 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c5562a9c-047d-4319-908f-adc6538f19f0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:59.847919 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c5562a9c-047d-4319-908f-adc6538f19f0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:45:59.848506 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c5562a9c-047d-4319-908f-adc6538f19f0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:45:59.997086 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c5562a9c-047d-4319-908f-adc6538f19f0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:00.005139 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c5562a9c-047d-4319-908f-adc6538f19f0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:00.006637 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c5562a9c-047d-4319-908f-adc6538f19f0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:00.007763 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c5562a9c-047d-4319-908f-adc6538f19f0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.171457 Aug 10 03:46:00.008336 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 565/1148] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:45:59 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:00.592986 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c1a8f323-c1ec-475f-ae10-7144bfc73907 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:00.593559 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c1a8f323-c1ec-475f-ae10-7144bfc73907 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:00.599635 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c1a8f323-c1ec-475f-ae10-7144bfc73907 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:00.600070 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c1a8f323-c1ec-475f-ae10-7144bfc73907 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:00.600859 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c1a8f323-c1ec-475f-ae10-7144bfc73907 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:00.601284 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c1a8f323-c1ec-475f-ae10-7144bfc73907 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:00.723457 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c1a8f323-c1ec-475f-ae10-7144bfc73907 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:00.732126 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c1a8f323-c1ec-475f-ae10-7144bfc73907 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1568 microversion: 2.1 time: 0.142521 Aug 10 03:46:00.732761 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 584/1149] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:00 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:00.751691 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-327ec74b-4bee-45d2-8cb5-ad7a32c76d87 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:00.752762 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-327ec74b-4bee-45d2-8cb5-ad7a32c76d87 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:00.762721 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-327ec74b-4bee-45d2-8cb5-ad7a32c76d87 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:00.763471 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-327ec74b-4bee-45d2-8cb5-ad7a32c76d87 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:00.764836 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-327ec74b-4bee-45d2-8cb5-ad7a32c76d87 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:00.765604 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-327ec74b-4bee-45d2-8cb5-ad7a32c76d87 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:01.027092 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c357f30f-9659-49a8-a803-41b1b915ee70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:01.028674 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c357f30f-9659-49a8-a803-41b1b915ee70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:01.035590 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c357f30f-9659-49a8-a803-41b1b915ee70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:01.036030 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c357f30f-9659-49a8-a803-41b1b915ee70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:01.036850 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c357f30f-9659-49a8-a803-41b1b915ee70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:01.037283 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c357f30f-9659-49a8-a803-41b1b915ee70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:01.141135 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-327ec74b-4bee-45d2-8cb5-ad7a32c76d87 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "POST /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970/action" status: 202 len: 0 microversion: 2.1 time: 0.395615 Aug 10 03:46:01.142818 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 566/1150] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:46:00 2021] POST /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:46:01.152098 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-cc42f776-93ee-45ab-ad13-0a7ef61b0617 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:01.153337 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-cc42f776-93ee-45ab-ad13-0a7ef61b0617 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:01.164544 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cc42f776-93ee-45ab-ad13-0a7ef61b0617 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:01.166749 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cc42f776-93ee-45ab-ad13-0a7ef61b0617 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:01.166749 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cc42f776-93ee-45ab-ad13-0a7ef61b0617 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:01.167354 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-cc42f776-93ee-45ab-ad13-0a7ef61b0617 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:01.174046 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c357f30f-9659-49a8-a803-41b1b915ee70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:01.187087 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c357f30f-9659-49a8-a803-41b1b915ee70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:01.189966 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c357f30f-9659-49a8-a803-41b1b915ee70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:01.191955 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c357f30f-9659-49a8-a803-41b1b915ee70 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.168923 Aug 10 03:46:01.193010 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 585/1151] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:01 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:46:01.331643 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-cc42f776-93ee-45ab-ad13-0a7ef61b0617 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:01.339302 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-cc42f776-93ee-45ab-ad13-0a7ef61b0617 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1516 microversion: 2.1 time: 0.192070 Aug 10 03:46:01.339963 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 567/1152] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:01 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1516 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:46:02.220425 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8b17562c-9834-47a0-bb89-c8cf4bccf44c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:02.221040 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8b17562c-9834-47a0-bb89-c8cf4bccf44c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:02.226929 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8b17562c-9834-47a0-bb89-c8cf4bccf44c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:02.229137 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8b17562c-9834-47a0-bb89-c8cf4bccf44c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:02.229137 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8b17562c-9834-47a0-bb89-c8cf4bccf44c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:02.229137 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8b17562c-9834-47a0-bb89-c8cf4bccf44c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:02.351726 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8b17562c-9834-47a0-bb89-c8cf4bccf44c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:02.357735 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0aa99e31-6ab7-4da0-b749-0a08dd26c450 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:02.358547 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0aa99e31-6ab7-4da0-b749-0a08dd26c450 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:02.366036 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0aa99e31-6ab7-4da0-b749-0a08dd26c450 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:02.366294 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8b17562c-9834-47a0-bb89-c8cf4bccf44c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:02.366499 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0aa99e31-6ab7-4da0-b749-0a08dd26c450 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:02.366499 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0aa99e31-6ab7-4da0-b749-0a08dd26c450 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:02.366499 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0aa99e31-6ab7-4da0-b749-0a08dd26c450 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:02.367333 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8b17562c-9834-47a0-bb89-c8cf4bccf44c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:02.368775 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8b17562c-9834-47a0-bb89-c8cf4bccf44c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.152038 Aug 10 03:46:02.369754 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 586/1153] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:02 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:02.513903 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0aa99e31-6ab7-4da0-b749-0a08dd26c450 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:02.521357 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0aa99e31-6ab7-4da0-b749-0a08dd26c450 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1516 microversion: 2.1 time: 0.168470 Aug 10 03:46:02.522069 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 568/1154] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:02 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:46:03.393562 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-eb0f3657-7a7b-4dc1-b33b-f534075ab92c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:03.394179 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-eb0f3657-7a7b-4dc1-b33b-f534075ab92c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:03.400189 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-eb0f3657-7a7b-4dc1-b33b-f534075ab92c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:03.400662 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-eb0f3657-7a7b-4dc1-b33b-f534075ab92c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:03.401439 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-eb0f3657-7a7b-4dc1-b33b-f534075ab92c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:03.401872 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-eb0f3657-7a7b-4dc1-b33b-f534075ab92c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:03.544795 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-99b20471-20c7-453a-a109-2ede2d157750 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:03.545859 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-99b20471-20c7-453a-a109-2ede2d157750 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:03.554654 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-eb0f3657-7a7b-4dc1-b33b-f534075ab92c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:03.558900 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-99b20471-20c7-453a-a109-2ede2d157750 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:03.560453 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-99b20471-20c7-453a-a109-2ede2d157750 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:03.561783 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-99b20471-20c7-453a-a109-2ede2d157750 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:03.562974 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-99b20471-20c7-453a-a109-2ede2d157750 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:03.563819 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-eb0f3657-7a7b-4dc1-b33b-f534075ab92c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:03.565474 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-eb0f3657-7a7b-4dc1-b33b-f534075ab92c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:03.566770 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-eb0f3657-7a7b-4dc1-b33b-f534075ab92c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.177363 Aug 10 03:46:03.567409 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 587/1155] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:03 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:46:03.582679 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-89cc8936-a904-427b-9329-9fe6735dd42e req-e5709ade-177b-4634-a8c1-605513125deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a89090-7d79-496b-878d-213d6f48b970", "name": "network-vif-unplugged", "status": "completed", "tag": "6f883b5b-35b9-44d5-8f3d-ba0bf7b04925"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:03.585642 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:46:03.585642 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:46:03.597279 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-89cc8936-a904-427b-9329-9fe6735dd42e req-e5709ade-177b-4634-a8c1-605513125deb service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:03.597997 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-89cc8936-a904-427b-9329-9fe6735dd42e req-e5709ade-177b-4634-a8c1-605513125deb service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:03.616669 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.compute.server_external_events [req-89cc8936-a904-427b-9329-9fe6735dd42e req-e5709ade-177b-4634-a8c1-605513125deb service nova] Unable to find a host for instance 43a89090-7d79-496b-878d-213d6f48b970. Dropping event network-vif-unplugged {{(pid=108439) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Aug 10 03:46:03.618083 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-89cc8936-a904-427b-9329-9fe6735dd42e req-e5709ade-177b-4634-a8c1-605513125deb service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044006 Aug 10 03:46:03.620248 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 588/1156] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:46:03 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 03:46:03.723715 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-99b20471-20c7-453a-a109-2ede2d157750 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:03.731397 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-99b20471-20c7-453a-a109-2ede2d157750 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1518 microversion: 2.1 time: 0.195299 Aug 10 03:46:03.732258 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 569/1157] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:03 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1518 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:04.585378 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-95473eb4-bb29-45ae-a607-18cb2f28ad95 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:04.586134 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-95473eb4-bb29-45ae-a607-18cb2f28ad95 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:04.592521 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-95473eb4-bb29-45ae-a607-18cb2f28ad95 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:04.592965 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-95473eb4-bb29-45ae-a607-18cb2f28ad95 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:04.593736 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-95473eb4-bb29-45ae-a607-18cb2f28ad95 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:04.594171 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-95473eb4-bb29-45ae-a607-18cb2f28ad95 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:04.733915 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-484489194", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1043484335", "security_groups": [{"name": "tempest-secgroup-smoke-1749124737"}], "block_device_mapping_v2": [{"uuid": "717d9e05-46ba-45db-b365-1e8243803dd7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ef50702a-750c-4693-9c57-2aafe4903705"}]}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:04.770704 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-95473eb4-bb29-45ae-a607-18cb2f28ad95 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:04.779196 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-95473eb4-bb29-45ae-a607-18cb2f28ad95 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:04.780706 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-95473eb4-bb29-45ae-a607-18cb2f28ad95 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:04.781883 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-95473eb4-bb29-45ae-a607-18cb2f28ad95 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.200279 Aug 10 03:46:04.782440 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 589/1158] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:04 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:46:04.786646 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-85664c99-8fc3-4fcb-aac8-83a90579e82f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:04.787453 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-85664c99-8fc3-4fcb-aac8-83a90579e82f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:04.794028 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-85664c99-8fc3-4fcb-aac8-83a90579e82f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:04.794484 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-85664c99-8fc3-4fcb-aac8-83a90579e82f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:04.795236 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-85664c99-8fc3-4fcb-aac8-83a90579e82f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:04.795658 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-85664c99-8fc3-4fcb-aac8-83a90579e82f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:04.912081 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.network.neutron [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] validate_networks() for [('ef50702a-750c-4693-9c57-2aafe4903705', None, None, None)] {{(pid=108440) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:46:04.936952 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-85664c99-8fc3-4fcb-aac8-83a90579e82f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:04.945918 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-85664c99-8fc3-4fcb-aac8-83a90579e82f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1518 microversion: 2.1 time: 0.162461 Aug 10 03:46:04.947231 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 590/1159] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:04 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:05.295385 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Flavor limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:46:05.295806 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Image limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:46:05.296366 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Flavor pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:46:05.296763 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Image pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:46:05.297166 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:46:05.306730 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:05.309243 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:05.309243 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:05.309243 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:05.324632 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Getting quotas for project 640c843532144cd4ac804d005116e62c. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:46:05.328681 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Getting quotas for user 8b443000b4ae4082ac0da4f090ede3b7 and project 640c843532144cd4ac804d005116e62c. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:46:05.389925 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Going to run 1 instances... {{(pid=108440) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:46:05.392300 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='717d9e05-46ba-45db-b365-1e8243803dd7',volume_size=None,volume_type=None)] {{(pid=108440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:46:05.803114 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-fe976c4f-3b6c-4be8-bb2a-47f9576c23a2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:05.803763 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-fe976c4f-3b6c-4be8-bb2a-47f9576c23a2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:05.809330 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fe976c4f-3b6c-4be8-bb2a-47f9576c23a2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:05.809765 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fe976c4f-3b6c-4be8-bb2a-47f9576c23a2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:05.810522 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fe976c4f-3b6c-4be8-bb2a-47f9576c23a2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:05.810941 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fe976c4f-3b6c-4be8-bb2a-47f9576c23a2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:05.946757 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-fe976c4f-3b6c-4be8-bb2a-47f9576c23a2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:05.949611 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-fe976c4f-3b6c-4be8-bb2a-47f9576c23a2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:05.951116 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-fe976c4f-3b6c-4be8-bb2a-47f9576c23a2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:05.952528 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-fe976c4f-3b6c-4be8-bb2a-47f9576c23a2 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.153526 Aug 10 03:46:05.953093 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 591/1160] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:05 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:05.957693 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a61a1cb8-662e-485a-9793-ffa2f9d5322a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:05.958907 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a61a1cb8-662e-485a-9793-ffa2f9d5322a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:05.965859 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a61a1cb8-662e-485a-9793-ffa2f9d5322a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:05.966330 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a61a1cb8-662e-485a-9793-ffa2f9d5322a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:05.967311 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a61a1cb8-662e-485a-9793-ffa2f9d5322a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:05.967744 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a61a1cb8-662e-485a-9793-ffa2f9d5322a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:05.985895 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f2f8fffe-b8c3-47f4-b6bd-ad1525a98891 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.259712 Aug 10 03:46:05.990897 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 570/1161] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:46:04 2021] POST /compute/v2.1/servers => generated 406 bytes in 1265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 03:46:05.999973 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a61a1cb8-662e-485a-9793-ffa2f9d5322a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045837 Aug 10 03:46:06.017332 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 592/1162] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:46:05 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:46:06.018290 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-50d66cc6-42d0-4672-8d8f-9a6daf8b1cd3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:06.018290 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-50d66cc6-42d0-4672-8d8f-9a6daf8b1cd3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:06.018684 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-13badc6c-09d7-4ee3-9ce2-cfb9644bea7b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:06.018684 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-13badc6c-09d7-4ee3-9ce2-cfb9644bea7b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:06.018880 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-50d66cc6-42d0-4672-8d8f-9a6daf8b1cd3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:06.018880 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-50d66cc6-42d0-4672-8d8f-9a6daf8b1cd3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:06.018880 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-50d66cc6-42d0-4672-8d8f-9a6daf8b1cd3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:06.018880 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-50d66cc6-42d0-4672-8d8f-9a6daf8b1cd3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:06.108542 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-13badc6c-09d7-4ee3-9ce2-cfb9644bea7b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:06.122638 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-13badc6c-09d7-4ee3-9ce2-cfb9644bea7b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1094 microversion: 2.1 time: 0.119583 Aug 10 03:46:06.124526 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 593/1163] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:06 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1094 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:06.181771 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-50d66cc6-42d0-4672-8d8f-9a6daf8b1cd3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:06.193417 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-50d66cc6-42d0-4672-8d8f-9a6daf8b1cd3 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1518 microversion: 2.1 time: 0.200186 Aug 10 03:46:06.194231 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 571/1164] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:05 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1518 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:06.237897 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2fe8a1a4-f5b2-4943-a993-ca4f06cd234e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:06.238413 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2fe8a1a4-f5b2-4943-a993-ca4f06cd234e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:06.244225 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2fe8a1a4-f5b2-4943-a993-ca4f06cd234e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:06.244656 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2fe8a1a4-f5b2-4943-a993-ca4f06cd234e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:06.245409 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2fe8a1a4-f5b2-4943-a993-ca4f06cd234e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:06.245829 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2fe8a1a4-f5b2-4943-a993-ca4f06cd234e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:06.275095 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2fe8a1a4-f5b2-4943-a993-ca4f06cd234e tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments/8c3b356a-e961-4b89-af20-34a25c165afe" status: 200 len: 194 microversion: 2.1 time: 0.040297 Aug 10 03:46:06.275502 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 594/1165] 10.222.0.21 () {58 vars in 1413 bytes} [Tue Aug 10 03:46:06 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments/8c3b356a-e961-4b89-af20-34a25c165afe => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:46:06.285579 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ff630b08-34ea-4916-ae2f-bb656b50ec6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:06.286072 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ff630b08-34ea-4916-ae2f-bb656b50ec6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:06.300384 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff630b08-34ea-4916-ae2f-bb656b50ec6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:06.300384 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff630b08-34ea-4916-ae2f-bb656b50ec6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:06.300384 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff630b08-34ea-4916-ae2f-bb656b50ec6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:06.300384 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ff630b08-34ea-4916-ae2f-bb656b50ec6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:06.392689 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-ff630b08-34ea-4916-ae2f-bb656b50ec6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lazy-loading 'services' on Instance uuid 39489822-b8f1-4176-a07f-4b84b1cd3d67 {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:46:06.406262 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9331e0d8-e49b-434d-8bef-24ffe0002c71 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1871543112"}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:06.406617 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9331e0d8-e49b-434d-8bef-24ffe0002c71 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:06.412490 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9331e0d8-e49b-434d-8bef-24ffe0002c71 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:06.412931 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9331e0d8-e49b-434d-8bef-24ffe0002c71 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:06.413900 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9331e0d8-e49b-434d-8bef-24ffe0002c71 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:06.414323 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9331e0d8-e49b-434d-8bef-24ffe0002c71 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:06.547750 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.network.security_group_api [None req-9331e0d8-e49b-434d-8bef-24ffe0002c71 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Removing security group 340df404-620c-44f6-ab98-79f03bb47b3f from port e4c32421-6086-4a06-97cd-96e3d3edc391 Aug 10 03:46:06.731904 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ff630b08-34ea-4916-ae2f-bb656b50ec6d tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "DELETE /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments/8c3b356a-e961-4b89-af20-34a25c165afe" status: 202 len: 0 microversion: 2.1 time: 0.449196 Aug 10 03:46:06.733582 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 572/1166] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 10 03:46:06 2021] DELETE /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments/8c3b356a-e961-4b89-af20-34a25c165afe => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:46:06.977867 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-70a0ef7e-9a4a-4da7-9745-582b07225c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:06.993106 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-70a0ef7e-9a4a-4da7-9745-582b07225c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:06.993106 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-70a0ef7e-9a4a-4da7-9745-582b07225c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:06.993106 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-70a0ef7e-9a4a-4da7-9745-582b07225c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:06.993106 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-70a0ef7e-9a4a-4da7-9745-582b07225c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:06.994123 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-70a0ef7e-9a4a-4da7-9745-582b07225c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:07.114638 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-70a0ef7e-9a4a-4da7-9745-582b07225c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:07.136331 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-70a0ef7e-9a4a-4da7-9745-582b07225c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:07.137692 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9331e0d8-e49b-434d-8bef-24ffe0002c71 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "POST /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/action" status: 202 len: 0 microversion: 2.1 time: 0.734563 Aug 10 03:46:07.139203 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 595/1167] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 10 03:46:06 2021] POST /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/action => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:46:07.142343 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-70a0ef7e-9a4a-4da7-9745-582b07225c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:07.145827 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-70a0ef7e-9a4a-4da7-9745-582b07225c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1742 microversion: 2.20 time: 0.170734 Aug 10 03:46:07.148162 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 573/1168] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:06 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1742 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:07.151721 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-7748d982-457c-46ae-9df6-02f593fa1b88 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:07.156584 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-7748d982-457c-46ae-9df6-02f593fa1b88 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:07.241407 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-7748d982-457c-46ae-9df6-02f593fa1b88 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:07.249336 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-7748d982-457c-46ae-9df6-02f593fa1b88 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1094 microversion: 2.1 time: 0.108698 Aug 10 03:46:07.249911 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 596/1169] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:07 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1094 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:07.256095 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-72fcf17c-2926-46af-950d-74f943930603 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:07.257014 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-72fcf17c-2926-46af-950d-74f943930603 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:07.264136 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-72fcf17c-2926-46af-950d-74f943930603 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:07.264927 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-72fcf17c-2926-46af-950d-74f943930603 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:07.265895 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-72fcf17c-2926-46af-950d-74f943930603 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:07.266484 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-72fcf17c-2926-46af-950d-74f943930603 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:07.458550 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-72fcf17c-2926-46af-950d-74f943930603 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:07.473978 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-72fcf17c-2926-46af-950d-74f943930603 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1574 microversion: 2.1 time: 0.221559 Aug 10 03:46:07.487586 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 597/1170] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:07 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1574 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:07.527490 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-4db10934-5aec-427d-a81f-296d60f026b1 req-7677d095-3985-459f-9d7b-f9900fefd808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2969b784-ae47-4dce-a4d1-f86c2d508de8", "tag": "e4c32421-6086-4a06-97cd-96e3d3edc391"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:07.531050 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:46:07.531050 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:46:07.549078 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-4db10934-5aec-427d-a81f-296d60f026b1 req-7677d095-3985-459f-9d7b-f9900fefd808 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:07.549847 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-4db10934-5aec-427d-a81f-296d60f026b1 req-7677d095-3985-459f-9d7b-f9900fefd808 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:07.571202 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-4db10934-5aec-427d-a81f-296d60f026b1 req-7677d095-3985-459f-9d7b-f9900fefd808 service nova] Creating event network-changed:e4c32421-6086-4a06-97cd-96e3d3edc391 for instance 2969b784-ae47-4dce-a4d1-f86c2d508de8 on hv-cinder-78239 Aug 10 03:46:07.577238 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-4db10934-5aec-427d-a81f-296d60f026b1 req-7677d095-3985-459f-9d7b-f9900fefd808 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.426463 Aug 10 03:46:07.579018 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 574/1171] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:46:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:46:08.167693 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-736f0f25-95a5-4607-b322-3152aff1fc80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:08.168529 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-736f0f25-95a5-4607-b322-3152aff1fc80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:08.175418 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-736f0f25-95a5-4607-b322-3152aff1fc80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:08.175992 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-736f0f25-95a5-4607-b322-3152aff1fc80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:08.176964 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-736f0f25-95a5-4607-b322-3152aff1fc80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:08.177434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-736f0f25-95a5-4607-b322-3152aff1fc80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:08.268004 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-70588181-13da-4d7e-8b46-4967c2ee1090 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:08.269509 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-70588181-13da-4d7e-8b46-4967c2ee1090 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:08.277669 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-70588181-13da-4d7e-8b46-4967c2ee1090 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:08.277669 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-70588181-13da-4d7e-8b46-4967c2ee1090 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:08.285164 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-70588181-13da-4d7e-8b46-4967c2ee1090 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:08.285164 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-70588181-13da-4d7e-8b46-4967c2ee1090 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:08.387092 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-70588181-13da-4d7e-8b46-4967c2ee1090 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:08.399932 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-70588181-13da-4d7e-8b46-4967c2ee1090 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1144 microversion: 2.1 time: 0.136243 Aug 10 03:46:08.404553 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-736f0f25-95a5-4607-b322-3152aff1fc80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:08.416316 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 575/1172] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:08 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1144 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:08.425561 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-736f0f25-95a5-4607-b322-3152aff1fc80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:08.427939 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-736f0f25-95a5-4607-b322-3152aff1fc80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:08.429879 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-736f0f25-95a5-4607-b322-3152aff1fc80 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1742 microversion: 2.20 time: 0.267409 Aug 10 03:46:08.431323 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 598/1173] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:08 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1742 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:08.500425 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-80f1f799-9c2b-47d8-b277-05b04570cbc0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:08.502010 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-80f1f799-9c2b-47d8-b277-05b04570cbc0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:08.515611 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80f1f799-9c2b-47d8-b277-05b04570cbc0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:08.517014 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80f1f799-9c2b-47d8-b277-05b04570cbc0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:08.518963 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80f1f799-9c2b-47d8-b277-05b04570cbc0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:08.520003 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80f1f799-9c2b-47d8-b277-05b04570cbc0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:08.708071 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-80f1f799-9c2b-47d8-b277-05b04570cbc0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:08.718830 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-80f1f799-9c2b-47d8-b277-05b04570cbc0 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1574 microversion: 2.1 time: 0.226329 Aug 10 03:46:08.719662 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 576/1174] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:08 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1574 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:08.948451 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5603878b-0cc1-45c9-99c1-680846c2aa05 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:08.949156 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-5603878b-0cc1-45c9-99c1-680846c2aa05 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:08.955247 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5603878b-0cc1-45c9-99c1-680846c2aa05 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:08.955764 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5603878b-0cc1-45c9-99c1-680846c2aa05 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:08.956633 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5603878b-0cc1-45c9-99c1-680846c2aa05 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:08.957065 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5603878b-0cc1-45c9-99c1-680846c2aa05 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:08.989456 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5603878b-0cc1-45c9-99c1-680846c2aa05 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments/ad05d8d9-38c5-4cc5-8ea7-29d128b7e76c" status: 200 len: 194 microversion: 2.1 time: 0.045137 Aug 10 03:46:08.990185 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 599/1175] 10.222.0.21 () {58 vars in 1413 bytes} [Tue Aug 10 03:46:08 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments/ad05d8d9-38c5-4cc5-8ea7-29d128b7e76c => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:46:09.000803 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b83a7ffd-61d4-4bba-829a-c5fb1f79dc9b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:09.001421 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b83a7ffd-61d4-4bba-829a-c5fb1f79dc9b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:09.007758 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b83a7ffd-61d4-4bba-829a-c5fb1f79dc9b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:09.008357 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b83a7ffd-61d4-4bba-829a-c5fb1f79dc9b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:09.009874 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b83a7ffd-61d4-4bba-829a-c5fb1f79dc9b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:09.010566 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b83a7ffd-61d4-4bba-829a-c5fb1f79dc9b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:09.030581 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c77d4a8b-22c2-4faa-8aa1-f178e129d0a6 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:09.031149 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c77d4a8b-22c2-4faa-8aa1-f178e129d0a6 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:09.037727 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c77d4a8b-22c2-4faa-8aa1-f178e129d0a6 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:09.038400 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c77d4a8b-22c2-4faa-8aa1-f178e129d0a6 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:09.039325 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c77d4a8b-22c2-4faa-8aa1-f178e129d0a6 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:09.039908 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c77d4a8b-22c2-4faa-8aa1-f178e129d0a6 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:09.152947 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-b83a7ffd-61d4-4bba-829a-c5fb1f79dc9b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lazy-loading 'services' on Instance uuid 39489822-b8f1-4176-a07f-4b84b1cd3d67 {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:46:09.193645 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-c77d4a8b-22c2-4faa-8aa1-f178e129d0a6 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lazy-loading 'services' on Instance uuid 2969b784-ae47-4dce-a4d1-f86c2d508de8 {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:46:09.526254 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c77d4a8b-22c2-4faa-8aa1-f178e129d0a6 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/os-volume_attachments/0c92d1c1-baa7-4e18-beca-220c33918bdd" status: 202 len: 0 microversion: 2.1 time: 0.500767 Aug 10 03:46:09.526876 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 600/1176] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 10 03:46:09 2021] DELETE /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/os-volume_attachments/0c92d1c1-baa7-4e18-beca-220c33918bdd => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:46:09.531379 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b83a7ffd-61d4-4bba-829a-c5fb1f79dc9b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "DELETE /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments/ad05d8d9-38c5-4cc5-8ea7-29d128b7e76c" status: 202 len: 0 microversion: 2.1 time: 0.532506 Aug 10 03:46:09.532178 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 577/1177] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 10 03:46:08 2021] DELETE /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments/ad05d8d9-38c5-4cc5-8ea7-29d128b7e76c => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 03:46:09.547525 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-58f18eee-7675-4284-a6ce-0bda87bf9c33 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:09.548242 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-58f18eee-7675-4284-a6ce-0bda87bf9c33 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:09.551898 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-97beb953-e313-483d-a297-790812ac2d99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:09.552641 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-97beb953-e313-483d-a297-790812ac2d99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:09.562519 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-58f18eee-7675-4284-a6ce-0bda87bf9c33 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:09.569392 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-58f18eee-7675-4284-a6ce-0bda87bf9c33 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:09.569392 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-58f18eee-7675-4284-a6ce-0bda87bf9c33 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:09.569392 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-58f18eee-7675-4284-a6ce-0bda87bf9c33 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:09.578034 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-97beb953-e313-483d-a297-790812ac2d99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:09.578476 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-97beb953-e313-483d-a297-790812ac2d99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:09.579261 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-97beb953-e313-483d-a297-790812ac2d99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:09.579688 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-97beb953-e313-483d-a297-790812ac2d99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:09.694569 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-58f18eee-7675-4284-a6ce-0bda87bf9c33 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:09.705118 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-58f18eee-7675-4284-a6ce-0bda87bf9c33 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1192 microversion: 2.1 time: 0.167573 Aug 10 03:46:09.718313 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 601/1178] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:09 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1192 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:09.724570 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-bd4de079-15da-40a4-9582-d1971f2a9490 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:09.725547 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-bd4de079-15da-40a4-9582-d1971f2a9490 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:09.733355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd4de079-15da-40a4-9582-d1971f2a9490 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:09.733799 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd4de079-15da-40a4-9582-d1971f2a9490 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:09.734582 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd4de079-15da-40a4-9582-d1971f2a9490 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:09.735004 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-bd4de079-15da-40a4-9582-d1971f2a9490 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:09.776329 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-bd4de079-15da-40a4-9582-d1971f2a9490 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056340 Aug 10 03:46:09.786982 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 602/1179] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:46:09 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:46:09.786982 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-0222c700-da37-4373-bd83-64fe0bd012dd req-3ff2010c-12db-4328-bee6-c87fed7bb401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2969b784-ae47-4dce-a4d1-f86c2d508de8", "tag": "e4c32421-6086-4a06-97cd-96e3d3edc391"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:09.786982 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:46:09.786982 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:46:09.792639 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-0222c700-da37-4373-bd83-64fe0bd012dd req-3ff2010c-12db-4328-bee6-c87fed7bb401 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:09.793222 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-0222c700-da37-4373-bd83-64fe0bd012dd req-3ff2010c-12db-4328-bee6-c87fed7bb401 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:09.806821 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-0222c700-da37-4373-bd83-64fe0bd012dd req-3ff2010c-12db-4328-bee6-c87fed7bb401 service nova] Creating event network-changed:e4c32421-6086-4a06-97cd-96e3d3edc391 for instance 2969b784-ae47-4dce-a4d1-f86c2d508de8 on hv-cinder-78239 Aug 10 03:46:09.812358 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-0222c700-da37-4373-bd83-64fe0bd012dd req-3ff2010c-12db-4328-bee6-c87fed7bb401 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033544 Aug 10 03:46:09.813740 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 603/1180] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:46:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:46:09.820476 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d0ac9702-1d2c-42c0-a52f-61a5792f37bd tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:09.822546 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d0ac9702-1d2c-42c0-a52f-61a5792f37bd tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:09.830293 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d0ac9702-1d2c-42c0-a52f-61a5792f37bd tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:09.831033 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d0ac9702-1d2c-42c0-a52f-61a5792f37bd tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:09.832113 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d0ac9702-1d2c-42c0-a52f-61a5792f37bd tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:09.833110 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d0ac9702-1d2c-42c0-a52f-61a5792f37bd tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:10.032780 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-97beb953-e313-483d-a297-790812ac2d99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:10.034559 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d0ac9702-1d2c-42c0-a52f-61a5792f37bd tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:10.058239 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d0ac9702-1d2c-42c0-a52f-61a5792f37bd tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1574 microversion: 2.1 time: 0.239435 Aug 10 03:46:10.059549 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 604/1181] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:09 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1574 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:10.080487 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-97beb953-e313-483d-a297-790812ac2d99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:10.080487 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-97beb953-e313-483d-a297-790812ac2d99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:10.080487 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-97beb953-e313-483d-a297-790812ac2d99 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1737 microversion: 2.20 time: 0.521976 Aug 10 03:46:10.081344 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 578/1182] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:09 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1737 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:10.727311 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1394c2ec-bd00-490c-9149-bbf74cf9f0e8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:10.728811 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1394c2ec-bd00-490c-9149-bbf74cf9f0e8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:10.741075 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1394c2ec-bd00-490c-9149-bbf74cf9f0e8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:10.742686 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1394c2ec-bd00-490c-9149-bbf74cf9f0e8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:10.749611 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1394c2ec-bd00-490c-9149-bbf74cf9f0e8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:10.750179 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1394c2ec-bd00-490c-9149-bbf74cf9f0e8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:10.792967 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-aea2bd6c-7ceb-4d4b-9413-866d92b5081f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:10.795581 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-aea2bd6c-7ceb-4d4b-9413-866d92b5081f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:10.812256 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aea2bd6c-7ceb-4d4b-9413-866d92b5081f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:10.813081 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aea2bd6c-7ceb-4d4b-9413-866d92b5081f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:10.816974 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aea2bd6c-7ceb-4d4b-9413-866d92b5081f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:10.817390 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aea2bd6c-7ceb-4d4b-9413-866d92b5081f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:10.860066 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-aea2bd6c-7ceb-4d4b-9413-866d92b5081f tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071805 Aug 10 03:46:10.860967 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 579/1183] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:46:10 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:46:10.919027 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1394c2ec-bd00-490c-9149-bbf74cf9f0e8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:10.926529 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1394c2ec-bd00-490c-9149-bbf74cf9f0e8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1210 microversion: 2.1 time: 0.202883 Aug 10 03:46:10.927849 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 605/1184] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:10 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1210 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:11.079955 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a5a98ef4-d8b4-4f51-aa14-2c56fabf5021 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:11.081030 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a5a98ef4-d8b4-4f51-aa14-2c56fabf5021 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:11.096816 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-543c39a4-eb0d-4f7c-a37c-522ded69acfd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:11.097586 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-543c39a4-eb0d-4f7c-a37c-522ded69acfd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:11.101103 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a5a98ef4-d8b4-4f51-aa14-2c56fabf5021 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:11.101825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a5a98ef4-d8b4-4f51-aa14-2c56fabf5021 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:11.103173 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a5a98ef4-d8b4-4f51-aa14-2c56fabf5021 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:11.103830 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a5a98ef4-d8b4-4f51-aa14-2c56fabf5021 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:11.104748 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-543c39a4-eb0d-4f7c-a37c-522ded69acfd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:11.105180 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-543c39a4-eb0d-4f7c-a37c-522ded69acfd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:11.105946 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-543c39a4-eb0d-4f7c-a37c-522ded69acfd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:11.106374 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-543c39a4-eb0d-4f7c-a37c-522ded69acfd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:11.275260 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-543c39a4-eb0d-4f7c-a37c-522ded69acfd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:11.287089 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-543c39a4-eb0d-4f7c-a37c-522ded69acfd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:11.291723 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-543c39a4-eb0d-4f7c-a37c-522ded69acfd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:11.291723 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-543c39a4-eb0d-4f7c-a37c-522ded69acfd tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1737 microversion: 2.20 time: 0.198023 Aug 10 03:46:11.291723 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 606/1185] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:11 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:11.407179 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a5a98ef4-d8b4-4f51-aa14-2c56fabf5021 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:11.418200 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a5a98ef4-d8b4-4f51-aa14-2c56fabf5021 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1574 microversion: 2.1 time: 0.342181 Aug 10 03:46:11.419042 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 580/1186] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:11 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1574 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:11.746734 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-72399302-59a1-4176-a92a-d4c31e996568 req-e9c0eba2-4681-4149-8807-d71f54393a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c37790e-ad20-4784-b0f0-20babcf19223", "name": "network-vif-plugged", "status": "completed", "tag": "638e6702-b0f3-46b1-b6c2-197d8b06363d"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:11.749587 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:46:11.749587 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:46:11.777752 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-72399302-59a1-4176-a92a-d4c31e996568 req-e9c0eba2-4681-4149-8807-d71f54393a32 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:11.778533 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-72399302-59a1-4176-a92a-d4c31e996568 req-e9c0eba2-4681-4149-8807-d71f54393a32 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:11.796674 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-72399302-59a1-4176-a92a-d4c31e996568 req-e9c0eba2-4681-4149-8807-d71f54393a32 service nova] Creating event network-vif-plugged:638e6702-b0f3-46b1-b6c2-197d8b06363d for instance 5c37790e-ad20-4784-b0f0-20babcf19223 on hv-cinder-78239 Aug 10 03:46:11.804519 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-72399302-59a1-4176-a92a-d4c31e996568 req-e9c0eba2-4681-4149-8807-d71f54393a32 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063915 Aug 10 03:46:11.806383 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 607/1187] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:46:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:46:11.878424 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f4c3398d-2391-4008-837d-4ade39f9c2e8 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:11.880410 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f4c3398d-2391-4008-837d-4ade39f9c2e8 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:11.892701 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f4c3398d-2391-4008-837d-4ade39f9c2e8 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:11.893466 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f4c3398d-2391-4008-837d-4ade39f9c2e8 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:11.894419 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f4c3398d-2391-4008-837d-4ade39f9c2e8 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:11.895031 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f4c3398d-2391-4008-837d-4ade39f9c2e8 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:11.942669 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f4c3398d-2391-4008-837d-4ade39f9c2e8 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072778 Aug 10 03:46:11.943820 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 581/1188] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:46:11 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:46:11.949238 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-19e743a9-dd58-4462-aaf1-feddb1cf42fa tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:11.950525 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-19e743a9-dd58-4462-aaf1-feddb1cf42fa tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:11.956313 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f678f7fb-7597-43d7-9b7b-a62f672c515b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:11.957050 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f678f7fb-7597-43d7-9b7b-a62f672c515b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:11.967787 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f678f7fb-7597-43d7-9b7b-a62f672c515b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:11.971383 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-19e743a9-dd58-4462-aaf1-feddb1cf42fa tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:11.971740 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f678f7fb-7597-43d7-9b7b-a62f672c515b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:11.972097 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-19e743a9-dd58-4462-aaf1-feddb1cf42fa tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:11.972744 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f678f7fb-7597-43d7-9b7b-a62f672c515b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:11.973247 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f678f7fb-7597-43d7-9b7b-a62f672c515b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:11.975099 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-19e743a9-dd58-4462-aaf1-feddb1cf42fa tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:11.975734 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-19e743a9-dd58-4462-aaf1-feddb1cf42fa tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:12.119701 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-f678f7fb-7597-43d7-9b7b-a62f672c515b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] HTTP exception thrown: Instance 2969b784-ae47-4dce-a4d1-f86c2d508de8 is not attached to volume 0c92d1c1-baa7-4e18-beca-220c33918bdd Aug 10 03:46:12.120401 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f678f7fb-7597-43d7-9b7b-a62f672c515b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Returning 404 to user: Instance 2969b784-ae47-4dce-a4d1-f86c2d508de8 is not attached to volume 0c92d1c1-baa7-4e18-beca-220c33918bdd {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:46:12.121512 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f678f7fb-7597-43d7-9b7b-a62f672c515b tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/os-volume_attachments/0c92d1c1-baa7-4e18-beca-220c33918bdd" status: 404 len: 154 microversion: 2.1 time: 0.169386 Aug 10 03:46:12.122895 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 582/1189] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 10 03:46:11 2021] DELETE /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8/os-volume_attachments/0c92d1c1-baa7-4e18-beca-220c33918bdd => generated 154 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 03:46:12.131970 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-19e743a9-dd58-4462-aaf1-feddb1cf42fa tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:12.156685 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-19e743a9-dd58-4462-aaf1-feddb1cf42fa tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1210 microversion: 2.1 time: 0.201153 Aug 10 03:46:12.156685 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 608/1190] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:11 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1210 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:12.311925 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ab64d420-5eb4-4fa6-abb3-13f6d4b2b542 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:12.312706 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ab64d420-5eb4-4fa6-abb3-13f6d4b2b542 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:12.318559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ab64d420-5eb4-4fa6-abb3-13f6d4b2b542 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:12.319024 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ab64d420-5eb4-4fa6-abb3-13f6d4b2b542 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:12.319763 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ab64d420-5eb4-4fa6-abb3-13f6d4b2b542 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:12.320189 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ab64d420-5eb4-4fa6-abb3-13f6d4b2b542 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:12.447979 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d495b72e-4285-4e30-b563-b320067a32a2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:12.451864 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d495b72e-4285-4e30-b563-b320067a32a2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:12.462724 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d495b72e-4285-4e30-b563-b320067a32a2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:12.463765 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d495b72e-4285-4e30-b563-b320067a32a2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:12.464857 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d495b72e-4285-4e30-b563-b320067a32a2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:12.465539 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d495b72e-4285-4e30-b563-b320067a32a2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:12.601587 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ab64d420-5eb4-4fa6-abb3-13f6d4b2b542 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:12.645856 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ab64d420-5eb4-4fa6-abb3-13f6d4b2b542 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:12.653324 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ab64d420-5eb4-4fa6-abb3-13f6d4b2b542 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:12.654933 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ab64d420-5eb4-4fa6-abb3-13f6d4b2b542 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1737 microversion: 2.20 time: 0.347332 Aug 10 03:46:12.657916 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 583/1191] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:12 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1737 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:12.793263 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d495b72e-4285-4e30-b563-b320067a32a2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:12.807455 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d495b72e-4285-4e30-b563-b320067a32a2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1574 microversion: 2.1 time: 0.369076 Aug 10 03:46:12.811216 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 609/1192] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:12 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1574 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:46:13.169103 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f040e603-124b-4495-8540-df3ab4e0a2a6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:13.170882 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f040e603-124b-4495-8540-df3ab4e0a2a6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:13.184780 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f040e603-124b-4495-8540-df3ab4e0a2a6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:13.185609 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f040e603-124b-4495-8540-df3ab4e0a2a6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:13.186639 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f040e603-124b-4495-8540-df3ab4e0a2a6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:13.187341 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f040e603-124b-4495-8540-df3ab4e0a2a6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:13.212618 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3338b117-7d41-4523-8fdc-50bb07cd6c98 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:13.213974 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3338b117-7d41-4523-8fdc-50bb07cd6c98 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:13.221202 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3338b117-7d41-4523-8fdc-50bb07cd6c98 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:13.221941 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3338b117-7d41-4523-8fdc-50bb07cd6c98 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:13.222988 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3338b117-7d41-4523-8fdc-50bb07cd6c98 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:13.223583 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3338b117-7d41-4523-8fdc-50bb07cd6c98 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:13.281580 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3338b117-7d41-4523-8fdc-50bb07cd6c98 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076061 Aug 10 03:46:13.283035 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 610/1193] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:46:13 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:46:13.402222 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f040e603-124b-4495-8540-df3ab4e0a2a6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:13.419616 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f040e603-124b-4495-8540-df3ab4e0a2a6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1278 microversion: 2.1 time: 0.255462 Aug 10 03:46:13.424602 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 584/1194] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:13 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1278 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:13.478577 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5fac7dca-996c-42cc-a92f-823ef4293cf6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:13.479630 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-5fac7dca-996c-42cc-a92f-823ef4293cf6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:13.492713 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5fac7dca-996c-42cc-a92f-823ef4293cf6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:13.495479 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5fac7dca-996c-42cc-a92f-823ef4293cf6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:13.496428 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5fac7dca-996c-42cc-a92f-823ef4293cf6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:13.496834 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5fac7dca-996c-42cc-a92f-823ef4293cf6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:13.549410 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5fac7dca-996c-42cc-a92f-823ef4293cf6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075784 Aug 10 03:46:13.556291 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 611/1195] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 10 03:46:13 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 03:46:13.660534 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-727d43c8-54af-4cdf-ac93-a99b846449af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:13.660845 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-727d43c8-54af-4cdf-ac93-a99b846449af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:13.668405 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-727d43c8-54af-4cdf-ac93-a99b846449af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:13.668855 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-727d43c8-54af-4cdf-ac93-a99b846449af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:13.669731 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-727d43c8-54af-4cdf-ac93-a99b846449af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:13.670345 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-727d43c8-54af-4cdf-ac93-a99b846449af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:13.675067 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f77b44bf-16bf-4005-a029-719a64fc6abc tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:13.676051 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f77b44bf-16bf-4005-a029-719a64fc6abc tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:13.683794 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f77b44bf-16bf-4005-a029-719a64fc6abc tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:13.684563 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f77b44bf-16bf-4005-a029-719a64fc6abc tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:13.685527 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f77b44bf-16bf-4005-a029-719a64fc6abc tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:13.686609 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f77b44bf-16bf-4005-a029-719a64fc6abc tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:13.715097 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f77b44bf-16bf-4005-a029-719a64fc6abc tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Going to try to terminate instance {{(pid=108439) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:46:13.724232 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-727d43c8-54af-4cdf-ac93-a99b846449af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Going to try to terminate instance {{(pid=108440) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:46:14.777983 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-727d43c8-54af-4cdf-ac93-a99b846449af tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "DELETE /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 204 len: 0 microversion: 2.1 time: 1.120916 Aug 10 03:46:14.778763 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f77b44bf-16bf-4005-a029-719a64fc6abc tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 204 len: 0 microversion: 2.1 time: 1.111105 Aug 10 03:46:14.782378 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 612/1197] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:46:13 2021] DELETE /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 0 bytes in 1113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:46:14.783066 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 585/1197] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:46:13 2021] DELETE /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 0 bytes in 1123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:46:14.785662 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-06bba372-2231-451e-8f94-17683a75c0fb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:14.786857 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-06bba372-2231-451e-8f94-17683a75c0fb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:14.788551 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-28794b71-3ef3-48c7-bbc1-a584aa2e3d8f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:14.792423 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-28794b71-3ef3-48c7-bbc1-a584aa2e3d8f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:14.796129 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-06bba372-2231-451e-8f94-17683a75c0fb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:14.796929 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-06bba372-2231-451e-8f94-17683a75c0fb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:14.797773 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-06bba372-2231-451e-8f94-17683a75c0fb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:14.798255 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-06bba372-2231-451e-8f94-17683a75c0fb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:14.802571 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-28794b71-3ef3-48c7-bbc1-a584aa2e3d8f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:14.804832 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-28794b71-3ef3-48c7-bbc1-a584aa2e3d8f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:14.806390 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-28794b71-3ef3-48c7-bbc1-a584aa2e3d8f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:14.807418 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-28794b71-3ef3-48c7-bbc1-a584aa2e3d8f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:14.949105 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-06bba372-2231-451e-8f94-17683a75c0fb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:14.957446 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-06bba372-2231-451e-8f94-17683a75c0fb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:14.959359 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-06bba372-2231-451e-8f94-17683a75c0fb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:14.960883 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-06bba372-2231-451e-8f94-17683a75c0fb tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1737 microversion: 2.20 time: 0.180330 Aug 10 03:46:14.964228 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 613/1198] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:14 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:14.969813 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-9132fd07-b059-4b5b-9389-e9208c308d27 req-1e41f24c-f6d4-4114-9d61-93076e1993c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eacc5386-d3bd-4440-8275-077517fbd610", "tag": "5c20a7ba-abbd-421f-82b7-17fb3d02b378"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:14.971018 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:46:14.971018 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:46:14.978394 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-9132fd07-b059-4b5b-9389-e9208c308d27 req-1e41f24c-f6d4-4114-9d61-93076e1993c8 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:14.978826 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-9132fd07-b059-4b5b-9389-e9208c308d27 req-1e41f24c-f6d4-4114-9d61-93076e1993c8 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:14.994483 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-9132fd07-b059-4b5b-9389-e9208c308d27 req-1e41f24c-f6d4-4114-9d61-93076e1993c8 service nova] Creating event network-changed:5c20a7ba-abbd-421f-82b7-17fb3d02b378 for instance eacc5386-d3bd-4440-8275-077517fbd610 on hv-cinder-78239 Aug 10 03:46:14.999359 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-9132fd07-b059-4b5b-9389-e9208c308d27 req-1e41f24c-f6d4-4114-9d61-93076e1993c8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033777 Aug 10 03:46:15.010065 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 614/1199] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:46:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:46:15.010065 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-3a596bb8-ba33-4002-87cb-9cfd3eb8cae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:15.010065 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-3a596bb8-ba33-4002-87cb-9cfd3eb8cae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:15.014161 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a596bb8-ba33-4002-87cb-9cfd3eb8cae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:15.015183 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a596bb8-ba33-4002-87cb-9cfd3eb8cae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:15.015434 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a596bb8-ba33-4002-87cb-9cfd3eb8cae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:15.015862 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-3a596bb8-ba33-4002-87cb-9cfd3eb8cae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:15.044074 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-28794b71-3ef3-48c7-bbc1-a584aa2e3d8f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:15.051797 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-28794b71-3ef3-48c7-bbc1-a584aa2e3d8f tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1574 microversion: 2.1 time: 0.267403 Aug 10 03:46:15.063504 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 586/1200] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:14 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1574 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:15.068622 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b5a6e14e-1138-4f57-b540-7caa1d9384e6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:15.069358 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b5a6e14e-1138-4f57-b540-7caa1d9384e6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:15.075741 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b5a6e14e-1138-4f57-b540-7caa1d9384e6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:15.076541 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b5a6e14e-1138-4f57-b540-7caa1d9384e6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:15.077618 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b5a6e14e-1138-4f57-b540-7caa1d9384e6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:15.078301 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b5a6e14e-1138-4f57-b540-7caa1d9384e6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:15.186191 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-3a596bb8-ba33-4002-87cb-9cfd3eb8cae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:15.195140 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-3a596bb8-ba33-4002-87cb-9cfd3eb8cae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1278 microversion: 2.1 time: 0.193998 Aug 10 03:46:15.196061 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 615/1201] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:14 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:15.201396 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-15f730af-5c03-4d09-b9f5-9eecc91b57be tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:15.202004 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-15f730af-5c03-4d09-b9f5-9eecc91b57be tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:15.207942 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-15f730af-5c03-4d09-b9f5-9eecc91b57be tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:15.208894 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-15f730af-5c03-4d09-b9f5-9eecc91b57be tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:15.210165 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-15f730af-5c03-4d09-b9f5-9eecc91b57be tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:15.210595 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-15f730af-5c03-4d09-b9f5-9eecc91b57be tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:15.314371 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b5a6e14e-1138-4f57-b540-7caa1d9384e6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:15.326162 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b5a6e14e-1138-4f57-b540-7caa1d9384e6 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1671 microversion: 2.1 time: 0.257737 Aug 10 03:46:15.326162 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 587/1202] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:15 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1671 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:15.405105 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-15f730af-5c03-4d09-b9f5-9eecc91b57be tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:15.414760 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-15f730af-5c03-4d09-b9f5-9eecc91b57be tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1554 microversion: 2.1 time: 0.217578 Aug 10 03:46:15.415355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 616/1203] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:15 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1554 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:15.981818 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c1b4a943-a5f9-4fa2-8238-84f073763532 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:15.983203 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c1b4a943-a5f9-4fa2-8238-84f073763532 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:15.989862 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1b4a943-a5f9-4fa2-8238-84f073763532 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:15.990651 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1b4a943-a5f9-4fa2-8238-84f073763532 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:15.991658 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1b4a943-a5f9-4fa2-8238-84f073763532 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:15.992161 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1b4a943-a5f9-4fa2-8238-84f073763532 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:16.070480 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d346c740-1d14-4cf8-b5b0-4865f20c567a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:16.071634 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d346c740-1d14-4cf8-b5b0-4865f20c567a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:16.088966 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d346c740-1d14-4cf8-b5b0-4865f20c567a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:16.089747 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d346c740-1d14-4cf8-b5b0-4865f20c567a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:16.090782 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d346c740-1d14-4cf8-b5b0-4865f20c567a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:16.091433 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d346c740-1d14-4cf8-b5b0-4865f20c567a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:16.237133 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d346c740-1d14-4cf8-b5b0-4865f20c567a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:16.246344 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d346c740-1d14-4cf8-b5b0-4865f20c567a tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1574 microversion: 2.1 time: 0.179606 Aug 10 03:46:16.247302 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 617/1204] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:16 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:46:16.252244 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-87adc5ca-0617-405e-848e-fd547429a7ce tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:16.253145 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-87adc5ca-0617-405e-848e-fd547429a7ce tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:16.257093 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c1b4a943-a5f9-4fa2-8238-84f073763532 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:16.261976 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-87adc5ca-0617-405e-848e-fd547429a7ce tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:16.262675 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-87adc5ca-0617-405e-848e-fd547429a7ce tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:16.263651 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-87adc5ca-0617-405e-848e-fd547429a7ce tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:16.264275 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-87adc5ca-0617-405e-848e-fd547429a7ce tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:16.265836 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c1b4a943-a5f9-4fa2-8238-84f073763532 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:16.270898 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c1b4a943-a5f9-4fa2-8238-84f073763532 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:16.272337 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c1b4a943-a5f9-4fa2-8238-84f073763532 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1737 microversion: 2.20 time: 0.294856 Aug 10 03:46:16.273485 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 588/1205] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:15 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1737 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:16.340245 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f9154b32-5471-4762-8ff9-14cdd8868a26 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:16.341211 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f9154b32-5471-4762-8ff9-14cdd8868a26 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:16.347616 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f9154b32-5471-4762-8ff9-14cdd8868a26 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:16.348047 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f9154b32-5471-4762-8ff9-14cdd8868a26 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:16.348852 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f9154b32-5471-4762-8ff9-14cdd8868a26 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:16.349279 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f9154b32-5471-4762-8ff9-14cdd8868a26 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:16.429305 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-87adc5ca-0617-405e-848e-fd547429a7ce tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:16.438618 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-87adc5ca-0617-405e-848e-fd547429a7ce tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1266 microversion: 2.1 time: 0.189910 Aug 10 03:46:16.439670 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 618/1206] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:16 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:16.444024 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-512f72ac-e56b-4aff-ae3b-8404c977fc1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:16.444885 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-512f72ac-e56b-4aff-ae3b-8404c977fc1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:16.451245 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-512f72ac-e56b-4aff-ae3b-8404c977fc1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:16.451859 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-512f72ac-e56b-4aff-ae3b-8404c977fc1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:16.452777 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-512f72ac-e56b-4aff-ae3b-8404c977fc1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:16.453318 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-512f72ac-e56b-4aff-ae3b-8404c977fc1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:16.519349 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f9154b32-5471-4762-8ff9-14cdd8868a26 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:16.528489 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f9154b32-5471-4762-8ff9-14cdd8868a26 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1671 microversion: 2.1 time: 0.192131 Aug 10 03:46:16.539011 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 589/1207] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:16 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1671 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:46:16.600966 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-512f72ac-e56b-4aff-ae3b-8404c977fc1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:16.609855 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-512f72ac-e56b-4aff-ae3b-8404c977fc1c tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1554 microversion: 2.1 time: 0.168946 Aug 10 03:46:16.612241 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 619/1208] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:16 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:17.267745 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-fa58c75b-d851-4174-b7ee-a054e01633fc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:17.269365 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-fa58c75b-d851-4174-b7ee-a054e01633fc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:17.277035 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fa58c75b-d851-4174-b7ee-a054e01633fc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:17.277819 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fa58c75b-d851-4174-b7ee-a054e01633fc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:17.278845 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fa58c75b-d851-4174-b7ee-a054e01633fc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:17.279507 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fa58c75b-d851-4174-b7ee-a054e01633fc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:17.291351 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f6aa829e-5bb9-4832-9af3-3775dc092421 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:17.291925 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f6aa829e-5bb9-4832-9af3-3775dc092421 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:17.307164 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f6aa829e-5bb9-4832-9af3-3775dc092421 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:17.307657 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f6aa829e-5bb9-4832-9af3-3775dc092421 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:17.308487 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f6aa829e-5bb9-4832-9af3-3775dc092421 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:17.308925 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f6aa829e-5bb9-4832-9af3-3775dc092421 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:17.532333 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f6aa829e-5bb9-4832-9af3-3775dc092421 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:17.547274 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f6aa829e-5bb9-4832-9af3-3775dc092421 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:17.550260 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f6aa829e-5bb9-4832-9af3-3775dc092421 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:17.556085 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f6aa829e-5bb9-4832-9af3-3775dc092421 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1737 microversion: 2.20 time: 0.269011 Aug 10 03:46:17.568087 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 620/1209] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:17 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1737 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:17.568412 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0117e6aa-787e-4350-a36a-f9cd03f78fee tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:17.569266 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0117e6aa-787e-4350-a36a-f9cd03f78fee tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:17.596781 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0117e6aa-787e-4350-a36a-f9cd03f78fee tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:17.596781 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0117e6aa-787e-4350-a36a-f9cd03f78fee tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:17.597549 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0117e6aa-787e-4350-a36a-f9cd03f78fee tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:17.598160 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0117e6aa-787e-4350-a36a-f9cd03f78fee tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:17.657203 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-fa58c75b-d851-4174-b7ee-a054e01633fc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:17.673501 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-fa58c75b-d851-4174-b7ee-a054e01633fc tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1574 microversion: 2.1 time: 0.408999 Aug 10 03:46:17.673501 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 590/1210] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:17 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1574 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:17.678440 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-934c74d5-b8a7-4646-a333-dd3f1f3ba1ff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:17.679403 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-934c74d5-b8a7-4646-a333-dd3f1f3ba1ff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:17.688086 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-934c74d5-b8a7-4646-a333-dd3f1f3ba1ff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:17.688670 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-934c74d5-b8a7-4646-a333-dd3f1f3ba1ff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:17.689587 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-934c74d5-b8a7-4646-a333-dd3f1f3ba1ff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:17.690134 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-934c74d5-b8a7-4646-a333-dd3f1f3ba1ff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:17.809059 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0117e6aa-787e-4350-a36a-f9cd03f78fee tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:17.818029 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0117e6aa-787e-4350-a36a-f9cd03f78fee tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1266 microversion: 2.1 time: 0.259521 Aug 10 03:46:17.818615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 621/1211] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:17 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:17.823662 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ae7a0803-3b56-49eb-851b-8ac335482978 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:17.824309 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ae7a0803-3b56-49eb-851b-8ac335482978 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:17.830575 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ae7a0803-3b56-49eb-851b-8ac335482978 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:17.830777 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ae7a0803-3b56-49eb-851b-8ac335482978 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:17.832013 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ae7a0803-3b56-49eb-851b-8ac335482978 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:17.832793 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ae7a0803-3b56-49eb-851b-8ac335482978 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:17.960723 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ae7a0803-3b56-49eb-851b-8ac335482978 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:17.976179 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ae7a0803-3b56-49eb-851b-8ac335482978 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1554 microversion: 2.1 time: 0.147756 Aug 10 03:46:17.976179 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 622/1212] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:17 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:18.048853 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-934c74d5-b8a7-4646-a333-dd3f1f3ba1ff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:18.057362 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-934c74d5-b8a7-4646-a333-dd3f1f3ba1ff tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1671 microversion: 2.1 time: 0.384490 Aug 10 03:46:18.058031 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 591/1213] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:17 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1671 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:18.576183 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e9afaaa6-15f7-4f47-82db-79a5ff8cb997 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:18.576831 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e9afaaa6-15f7-4f47-82db-79a5ff8cb997 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:18.583776 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e9afaaa6-15f7-4f47-82db-79a5ff8cb997 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:18.584237 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e9afaaa6-15f7-4f47-82db-79a5ff8cb997 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:18.585004 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e9afaaa6-15f7-4f47-82db-79a5ff8cb997 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:18.585440 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e9afaaa6-15f7-4f47-82db-79a5ff8cb997 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:18.690629 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-98f09ce9-9005-4d29-a23f-f6d30c1db5ff tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:18.691429 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-98f09ce9-9005-4d29-a23f-f6d30c1db5ff tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:18.698108 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-98f09ce9-9005-4d29-a23f-f6d30c1db5ff tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:18.698546 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-98f09ce9-9005-4d29-a23f-f6d30c1db5ff tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:18.699321 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-98f09ce9-9005-4d29-a23f-f6d30c1db5ff tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:18.699744 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-98f09ce9-9005-4d29-a23f-f6d30c1db5ff tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:18.721807 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e9afaaa6-15f7-4f47-82db-79a5ff8cb997 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:18.749192 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e9afaaa6-15f7-4f47-82db-79a5ff8cb997 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:18.751532 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e9afaaa6-15f7-4f47-82db-79a5ff8cb997 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:18.752776 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e9afaaa6-15f7-4f47-82db-79a5ff8cb997 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1737 microversion: 2.20 time: 0.180419 Aug 10 03:46:18.764563 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 623/1214] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:18 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:18.837300 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2c72ceb8-8e87-468a-a8ce-58d415189510 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:18.839219 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2c72ceb8-8e87-468a-a8ce-58d415189510 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:18.848607 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2c72ceb8-8e87-468a-a8ce-58d415189510 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:18.849322 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2c72ceb8-8e87-468a-a8ce-58d415189510 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:18.850146 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2c72ceb8-8e87-468a-a8ce-58d415189510 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:18.850689 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2c72ceb8-8e87-468a-a8ce-58d415189510 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:19.052131 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2c72ceb8-8e87-468a-a8ce-58d415189510 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:19.062718 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2c72ceb8-8e87-468a-a8ce-58d415189510 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1266 microversion: 2.1 time: 0.230649 Aug 10 03:46:19.074779 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 624/1215] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:18 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:19.074779 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9029f371-657a-4210-a5b6-68918e275bd0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:19.074779 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9029f371-657a-4210-a5b6-68918e275bd0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:19.076598 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9029f371-657a-4210-a5b6-68918e275bd0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:19.077057 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9029f371-657a-4210-a5b6-68918e275bd0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:19.077834 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9029f371-657a-4210-a5b6-68918e275bd0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:19.078281 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9029f371-657a-4210-a5b6-68918e275bd0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:19.248702 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-98f09ce9-9005-4d29-a23f-f6d30c1db5ff tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:19.262207 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-98f09ce9-9005-4d29-a23f-f6d30c1db5ff tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1574 microversion: 2.1 time: 0.575134 Aug 10 03:46:19.262906 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 592/1216] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:18 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1574 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:19.272925 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-f97b3eda-03e5-4355-83b0-90418ab25168 req-2cf0c05b-22d5-47a9-b846-375c7bb24dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2969b784-ae47-4dce-a4d1-f86c2d508de8", "name": "network-vif-deleted", "tag": "e4c32421-6086-4a06-97cd-96e3d3edc391"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:19.279172 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:46:19.279172 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:46:19.297880 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-f97b3eda-03e5-4355-83b0-90418ab25168 req-2cf0c05b-22d5-47a9-b846-375c7bb24dfb service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:19.299909 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-f97b3eda-03e5-4355-83b0-90418ab25168 req-2cf0c05b-22d5-47a9-b846-375c7bb24dfb service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:19.334693 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-f97b3eda-03e5-4355-83b0-90418ab25168 req-2cf0c05b-22d5-47a9-b846-375c7bb24dfb service nova] Creating event network-vif-deleted:e4c32421-6086-4a06-97cd-96e3d3edc391 for instance 2969b784-ae47-4dce-a4d1-f86c2d508de8 on hv-cinder-78239 Aug 10 03:46:19.353763 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-f97b3eda-03e5-4355-83b0-90418ab25168 req-2cf0c05b-22d5-47a9-b846-375c7bb24dfb service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085991 Aug 10 03:46:19.354806 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 593/1217] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:46:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:46:19.374135 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-fcb9fb38-7b3e-4764-a2ac-bc9d1cf5590b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:19.376514 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-fcb9fb38-7b3e-4764-a2ac-bc9d1cf5590b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:19.417288 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fcb9fb38-7b3e-4764-a2ac-bc9d1cf5590b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:19.418088 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fcb9fb38-7b3e-4764-a2ac-bc9d1cf5590b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:19.419097 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fcb9fb38-7b3e-4764-a2ac-bc9d1cf5590b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:19.419627 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fcb9fb38-7b3e-4764-a2ac-bc9d1cf5590b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:19.482881 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-9029f371-657a-4210-a5b6-68918e275bd0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bc1be4a0e5421aa5e8c2792f7fb05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:19.492494 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9029f371-657a-4210-a5b6-68918e275bd0 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 200 len: 1512 microversion: 2.1 time: 0.426950 Aug 10 03:46:19.495402 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 625/1218] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:19 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 1512 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:19.771675 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-be39762f-180c-429c-ac65-637396212a1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:19.772464 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-be39762f-180c-429c-ac65-637396212a1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:19.792770 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-be39762f-180c-429c-ac65-637396212a1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:19.793626 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-be39762f-180c-429c-ac65-637396212a1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:19.800278 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-be39762f-180c-429c-ac65-637396212a1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:19.807042 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-be39762f-180c-429c-ac65-637396212a1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:19.875927 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-fcb9fb38-7b3e-4764-a2ac-bc9d1cf5590b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:19.908452 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-fcb9fb38-7b3e-4764-a2ac-bc9d1cf5590b tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1603 microversion: 2.1 time: 0.537537 Aug 10 03:46:19.912014 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 594/1219] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:19 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1603 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:20.011642 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-be39762f-180c-429c-ac65-637396212a1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:20.033981 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-be39762f-180c-429c-ac65-637396212a1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:20.035474 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-be39762f-180c-429c-ac65-637396212a1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:20.036651 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-be39762f-180c-429c-ac65-637396212a1c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1737 microversion: 2.20 time: 0.269635 Aug 10 03:46:20.049794 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 626/1220] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:19 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1737 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:46:20.091002 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4833c320-aa90-41db-8ce5-09829c078d61 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:20.092057 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4833c320-aa90-41db-8ce5-09829c078d61 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:20.112535 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4833c320-aa90-41db-8ce5-09829c078d61 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:20.113265 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4833c320-aa90-41db-8ce5-09829c078d61 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:20.114419 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4833c320-aa90-41db-8ce5-09829c078d61 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:20.114916 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4833c320-aa90-41db-8ce5-09829c078d61 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:20.281819 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f44114b1-b03e-447c-ada6-05bcda99e6d6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:20.283687 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f44114b1-b03e-447c-ada6-05bcda99e6d6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:20.291662 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f44114b1-b03e-447c-ada6-05bcda99e6d6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:20.292449 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f44114b1-b03e-447c-ada6-05bcda99e6d6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:20.293443 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f44114b1-b03e-447c-ada6-05bcda99e6d6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:20.294080 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f44114b1-b03e-447c-ada6-05bcda99e6d6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:20.328984 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-4833c320-aa90-41db-8ce5-09829c078d61 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:20.349447 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4833c320-aa90-41db-8ce5-09829c078d61 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1266 microversion: 2.1 time: 0.269717 Aug 10 03:46:20.350430 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 595/1221] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:20 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:20.468847 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f44114b1-b03e-447c-ada6-05bcda99e6d6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:20.482281 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f44114b1-b03e-447c-ada6-05bcda99e6d6 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1574 microversion: 2.1 time: 0.206299 Aug 10 03:46:20.488258 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 627/1222] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:20 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1574 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:46:20.515888 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-48fec53c-4190-4522-911b-f84b7ecf63a2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:20.521109 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-48fec53c-4190-4522-911b-f84b7ecf63a2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] [instance: 2969b784-ae47-4dce-a4d1-f86c2d508de8] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:20.532114 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-48fec53c-4190-4522-911b-f84b7ecf63a2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:20.533348 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-48fec53c-4190-4522-911b-f84b7ecf63a2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:20.534336 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-48fec53c-4190-4522-911b-f84b7ecf63a2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:20.534921 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-48fec53c-4190-4522-911b-f84b7ecf63a2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:20.551667 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-48fec53c-4190-4522-911b-f84b7ecf63a2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] HTTP exception thrown: Instance 2969b784-ae47-4dce-a4d1-f86c2d508de8 could not be found. Aug 10 03:46:20.552843 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-48fec53c-4190-4522-911b-f84b7ecf63a2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Returning 404 to user: Instance 2969b784-ae47-4dce-a4d1-f86c2d508de8 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:46:20.553904 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-48fec53c-4190-4522-911b-f84b7ecf63a2 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8" status: 404 len: 111 microversion: 2.1 time: 0.043566 Aug 10 03:46:20.559105 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 596/1223] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:20 2021] GET /compute/v2.1/servers/2969b784-ae47-4dce-a4d1-f86c2d508de8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:46:20.565860 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5c2b8672-8f7b-4335-8f2d-e2b8921edc08 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] Calling method '.version_select at 0x7f9793ed94c0>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:20.732446 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5c2b8672-8f7b-4335-8f2d-e2b8921edc08 tempest-TestMinimumBasicScenario-740589141 tempest-TestMinimumBasicScenario-740589141-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1413623835" status: 202 len: 0 microversion: 2.1 time: 0.171230 Aug 10 03:46:20.733327 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 628/1224] 10.222.0.21 () {58 vars in 1272 bytes} [Tue Aug 10 03:46:20 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1413623835 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:46:20.928849 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b1535413-55ec-4b5a-835f-55e7c6895fae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:20.930368 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b1535413-55ec-4b5a-835f-55e7c6895fae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:20.940427 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b1535413-55ec-4b5a-835f-55e7c6895fae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:20.941161 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b1535413-55ec-4b5a-835f-55e7c6895fae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:20.942129 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b1535413-55ec-4b5a-835f-55e7c6895fae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:20.942822 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b1535413-55ec-4b5a-835f-55e7c6895fae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:20.980743 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b1535413-55ec-4b5a-835f-55e7c6895fae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:20.981113 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b1535413-55ec-4b5a-835f-55e7c6895fae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:20.982033 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-b1535413-55ec-4b5a-835f-55e7c6895fae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lazy-loading 'fault' on Instance uuid 39489822-b8f1-4176-a07f-4b84b1cd3d67 {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:46:21.027402 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b1535413-55ec-4b5a-835f-55e7c6895fae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a2db05b54e45fba8475e7949a61d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9e9e54834e4fe682d4305010655be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:21.036136 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b1535413-55ec-4b5a-835f-55e7c6895fae tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 200 len: 1326 microversion: 2.1 time: 0.111105 Aug 10 03:46:21.050525 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 597/1225] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:20 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 1326 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:21.058111 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-4f28d7d9-02ac-40d7-b35d-84b79aa6c92f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:21.059228 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-4f28d7d9-02ac-40d7-b35d-84b79aa6c92f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:21.066798 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4f28d7d9-02ac-40d7-b35d-84b79aa6c92f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:21.067428 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4f28d7d9-02ac-40d7-b35d-84b79aa6c92f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:21.068420 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4f28d7d9-02ac-40d7-b35d-84b79aa6c92f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:21.069443 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-4f28d7d9-02ac-40d7-b35d-84b79aa6c92f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:21.247503 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4f28d7d9-02ac-40d7-b35d-84b79aa6c92f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:21.261123 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4f28d7d9-02ac-40d7-b35d-84b79aa6c92f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:21.268015 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4f28d7d9-02ac-40d7-b35d-84b79aa6c92f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:21.274844 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-4f28d7d9-02ac-40d7-b35d-84b79aa6c92f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1737 microversion: 2.20 time: 0.219964 Aug 10 03:46:21.276006 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 629/1226] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:21 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 03:46:21.369040 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-982355c4-7127-4db0-a3a1-bc0cf6dd3f51 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:21.369643 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-982355c4-7127-4db0-a3a1-bc0cf6dd3f51 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:21.382090 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-982355c4-7127-4db0-a3a1-bc0cf6dd3f51 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:21.382537 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-982355c4-7127-4db0-a3a1-bc0cf6dd3f51 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:21.384082 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-982355c4-7127-4db0-a3a1-bc0cf6dd3f51 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:21.384703 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-982355c4-7127-4db0-a3a1-bc0cf6dd3f51 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:21.404902 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-6f787e05-d7cf-4501-8937-cf3d17396416 req-be04e59b-8014-4a5c-af63-b33810d00aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39489822-b8f1-4176-a07f-4b84b1cd3d67", "name": "network-vif-deleted", "tag": "1fd204ba-f590-4c87-bff7-78c11eab8e44"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:21.406573 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:46:21.406573 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:46:21.429088 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-6f787e05-d7cf-4501-8937-cf3d17396416 req-be04e59b-8014-4a5c-af63-b33810d00aad service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:21.430903 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-6f787e05-d7cf-4501-8937-cf3d17396416 req-be04e59b-8014-4a5c-af63-b33810d00aad service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:21.470664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-6f787e05-d7cf-4501-8937-cf3d17396416 req-be04e59b-8014-4a5c-af63-b33810d00aad service nova] Creating event network-vif-deleted:1fd204ba-f590-4c87-bff7-78c11eab8e44 for instance 39489822-b8f1-4176-a07f-4b84b1cd3d67 on hv-cinder-78239 Aug 10 03:46:21.477027 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-6f787e05-d7cf-4501-8937-cf3d17396416 req-be04e59b-8014-4a5c-af63-b33810d00aad service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075548 Aug 10 03:46:21.477656 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 630/1227] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:46:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:46:21.500645 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-fbaa0fb9-5916-401b-a2c9-e715b1fa2d0d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:21.504159 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-fbaa0fb9-5916-401b-a2c9-e715b1fa2d0d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:21.521490 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbaa0fb9-5916-401b-a2c9-e715b1fa2d0d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:21.522173 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbaa0fb9-5916-401b-a2c9-e715b1fa2d0d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:21.523027 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbaa0fb9-5916-401b-a2c9-e715b1fa2d0d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:21.523461 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-fbaa0fb9-5916-401b-a2c9-e715b1fa2d0d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:21.613288 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-982355c4-7127-4db0-a3a1-bc0cf6dd3f51 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:21.622498 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-982355c4-7127-4db0-a3a1-bc0cf6dd3f51 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1266 microversion: 2.1 time: 0.257140 Aug 10 03:46:21.623077 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 598/1228] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:21 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:21.737337 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-fbaa0fb9-5916-401b-a2c9-e715b1fa2d0d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:21.742017 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-fbaa0fb9-5916-401b-a2c9-e715b1fa2d0d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1574 microversion: 2.1 time: 0.245233 Aug 10 03:46:21.744151 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 631/1229] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:21 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1574 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:21.775604 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-7dfe8e9f-1523-4fe3-a0cd-ca137a9624cd req-e786b458-5f41-4a89-bf87-d707c3cfe430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a89090-7d79-496b-878d-213d6f48b970", "name": "network-vif-plugged", "status": "completed", "tag": "6f883b5b-35b9-44d5-8f3d-ba0bf7b04925"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:21.777924 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:46:21.777924 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:46:21.790803 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-7dfe8e9f-1523-4fe3-a0cd-ca137a9624cd req-e786b458-5f41-4a89-bf87-d707c3cfe430 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:21.791357 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-7dfe8e9f-1523-4fe3-a0cd-ca137a9624cd req-e786b458-5f41-4a89-bf87-d707c3cfe430 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:21.807097 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-7dfe8e9f-1523-4fe3-a0cd-ca137a9624cd req-e786b458-5f41-4a89-bf87-d707c3cfe430 service nova] Creating event network-vif-plugged:6f883b5b-35b9-44d5-8f3d-ba0bf7b04925 for instance 43a89090-7d79-496b-878d-213d6f48b970 on hv-cinder-78239 Aug 10 03:46:21.812469 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-7dfe8e9f-1523-4fe3-a0cd-ca137a9624cd req-e786b458-5f41-4a89-bf87-d707c3cfe430 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042254 Aug 10 03:46:21.814564 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 599/1230] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:46:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:46:22.059243 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-eb5e5a08-a207-47e9-8201-91403d3b4c6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:22.060059 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-eb5e5a08-a207-47e9-8201-91403d3b4c6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:22.066784 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-eb5e5a08-a207-47e9-8201-91403d3b4c6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:22.067221 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-eb5e5a08-a207-47e9-8201-91403d3b4c6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:22.068085 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-eb5e5a08-a207-47e9-8201-91403d3b4c6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:22.068613 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-eb5e5a08-a207-47e9-8201-91403d3b4c6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:22.084049 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-eb5e5a08-a207-47e9-8201-91403d3b4c6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] HTTP exception thrown: Instance 39489822-b8f1-4176-a07f-4b84b1cd3d67 could not be found. Aug 10 03:46:22.092745 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-eb5e5a08-a207-47e9-8201-91403d3b4c6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Returning 404 to user: Instance 39489822-b8f1-4176-a07f-4b84b1cd3d67 could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:46:22.093926 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-eb5e5a08-a207-47e9-8201-91403d3b4c6a tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 404 len: 111 microversion: 2.1 time: 0.039880 Aug 10 03:46:22.094575 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 632/1231] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:22 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 03:46:22.114944 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-94a8cb41-43cb-446f-a21b-f36b9dd87bef tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '.version_select at 0x7f97a4f62a60>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:22.243052 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-94a8cb41-43cb-446f-a21b-f36b9dd87bef tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-782982339" status: 202 len: 0 microversion: 2.1 time: 0.135229 Aug 10 03:46:22.243921 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 600/1232] 10.222.0.21 () {58 vars in 1218 bytes} [Tue Aug 10 03:46:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-782982339 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:46:22.301613 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-552767d5-7014-4841-a494-489b053c21e7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:22.302338 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-552767d5-7014-4841-a494-489b053c21e7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:22.314104 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-552767d5-7014-4841-a494-489b053c21e7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:22.315165 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-552767d5-7014-4841-a494-489b053c21e7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:22.316714 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-552767d5-7014-4841-a494-489b053c21e7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:22.317587 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-552767d5-7014-4841-a494-489b053c21e7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:22.504763 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-552767d5-7014-4841-a494-489b053c21e7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:22.513196 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-552767d5-7014-4841-a494-489b053c21e7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:22.514670 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-552767d5-7014-4841-a494-489b053c21e7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:22.515820 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-552767d5-7014-4841-a494-489b053c21e7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1737 microversion: 2.20 time: 0.218583 Aug 10 03:46:22.516482 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 633/1233] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:22 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:22.642380 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7fe90a42-3ac4-4118-9ae0-198e9e007f17 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:22.643107 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7fe90a42-3ac4-4118-9ae0-198e9e007f17 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:22.649403 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7fe90a42-3ac4-4118-9ae0-198e9e007f17 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:22.649841 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7fe90a42-3ac4-4118-9ae0-198e9e007f17 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:22.650629 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7fe90a42-3ac4-4118-9ae0-198e9e007f17 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:22.651061 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7fe90a42-3ac4-4118-9ae0-198e9e007f17 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:22.772615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-55718228-8e6c-4bde-a18d-7c63b836fba1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:22.772615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-55718228-8e6c-4bde-a18d-7c63b836fba1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:22.772615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-55718228-8e6c-4bde-a18d-7c63b836fba1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:22.772615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-55718228-8e6c-4bde-a18d-7c63b836fba1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:22.773080 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-55718228-8e6c-4bde-a18d-7c63b836fba1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:22.773080 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-55718228-8e6c-4bde-a18d-7c63b836fba1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:22.782884 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7fe90a42-3ac4-4118-9ae0-198e9e007f17 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:22.790288 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7fe90a42-3ac4-4118-9ae0-198e9e007f17 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1266 microversion: 2.1 time: 0.151587 Aug 10 03:46:22.790851 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 601/1234] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:22 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:22.901070 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-55718228-8e6c-4bde-a18d-7c63b836fba1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:22.910084 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-55718228-8e6c-4bde-a18d-7c63b836fba1 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1574 microversion: 2.1 time: 0.151805 Aug 10 03:46:22.911288 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 634/1235] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:22 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:46:23.533463 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8c092971-a2ce-418e-b9e6-3017b2c78043 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:23.534075 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8c092971-a2ce-418e-b9e6-3017b2c78043 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:23.540674 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8c092971-a2ce-418e-b9e6-3017b2c78043 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:23.541131 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8c092971-a2ce-418e-b9e6-3017b2c78043 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:23.541910 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8c092971-a2ce-418e-b9e6-3017b2c78043 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:23.542341 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8c092971-a2ce-418e-b9e6-3017b2c78043 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:23.690679 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-8c092971-a2ce-418e-b9e6-3017b2c78043 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:23.699092 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-8c092971-a2ce-418e-b9e6-3017b2c78043 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:23.700718 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-8c092971-a2ce-418e-b9e6-3017b2c78043 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:23.702310 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8c092971-a2ce-418e-b9e6-3017b2c78043 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1737 microversion: 2.20 time: 0.172646 Aug 10 03:46:23.713603 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 602/1236] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:23 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:23.807564 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f9915358-cda6-40c3-9726-15e395b4d1c3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:23.807564 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f9915358-cda6-40c3-9726-15e395b4d1c3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:23.815029 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f9915358-cda6-40c3-9726-15e395b4d1c3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:23.816157 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f9915358-cda6-40c3-9726-15e395b4d1c3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:23.817962 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f9915358-cda6-40c3-9726-15e395b4d1c3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:23.818735 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f9915358-cda6-40c3-9726-15e395b4d1c3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:23.937160 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c0ff8700-a882-4d4a-b459-46510f71bd2d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:23.937776 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c0ff8700-a882-4d4a-b459-46510f71bd2d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:23.945269 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c0ff8700-a882-4d4a-b459-46510f71bd2d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:23.945711 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c0ff8700-a882-4d4a-b459-46510f71bd2d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:23.947479 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c0ff8700-a882-4d4a-b459-46510f71bd2d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:23.948077 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c0ff8700-a882-4d4a-b459-46510f71bd2d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:24.018225 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f9915358-cda6-40c3-9726-15e395b4d1c3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:24.028324 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f9915358-cda6-40c3-9726-15e395b4d1c3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1266 microversion: 2.1 time: 0.225189 Aug 10 03:46:24.033764 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 635/1237] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:23 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:24.148651 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c0ff8700-a882-4d4a-b459-46510f71bd2d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:24.156530 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c0ff8700-a882-4d4a-b459-46510f71bd2d tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1561 microversion: 2.1 time: 0.223264 Aug 10 03:46:24.157104 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 603/1238] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:23 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1561 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:24.720840 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0cc17bc1-5588-4210-9494-650b2aa2e1b7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:24.721439 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0cc17bc1-5588-4210-9494-650b2aa2e1b7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:24.732686 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0cc17bc1-5588-4210-9494-650b2aa2e1b7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:24.739721 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0cc17bc1-5588-4210-9494-650b2aa2e1b7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:24.739721 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0cc17bc1-5588-4210-9494-650b2aa2e1b7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:24.739721 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0cc17bc1-5588-4210-9494-650b2aa2e1b7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:24.978664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0cc17bc1-5588-4210-9494-650b2aa2e1b7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:24.986919 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0cc17bc1-5588-4210-9494-650b2aa2e1b7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:24.988724 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0cc17bc1-5588-4210-9494-650b2aa2e1b7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:24.989863 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0cc17bc1-5588-4210-9494-650b2aa2e1b7 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1737 microversion: 2.20 time: 0.272764 Aug 10 03:46:24.990402 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 636/1239] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:24 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1737 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:25.044485 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-19de6071-d652-4224-b196-4cc51d093c5b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:25.045034 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-19de6071-d652-4224-b196-4cc51d093c5b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:25.050798 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-19de6071-d652-4224-b196-4cc51d093c5b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:25.051240 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-19de6071-d652-4224-b196-4cc51d093c5b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:25.052001 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-19de6071-d652-4224-b196-4cc51d093c5b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:25.052460 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-19de6071-d652-4224-b196-4cc51d093c5b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:25.178647 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-19de6071-d652-4224-b196-4cc51d093c5b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:25.186757 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-19de6071-d652-4224-b196-4cc51d093c5b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1266 microversion: 2.1 time: 0.145975 Aug 10 03:46:25.187321 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 604/1240] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:25 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:46:26.008887 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2dbfd6de-0fea-4225-a306-5e3e0bddd7c3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:26.010128 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2dbfd6de-0fea-4225-a306-5e3e0bddd7c3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:26.016473 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2dbfd6de-0fea-4225-a306-5e3e0bddd7c3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:26.017201 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2dbfd6de-0fea-4225-a306-5e3e0bddd7c3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:26.017992 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2dbfd6de-0fea-4225-a306-5e3e0bddd7c3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:26.018620 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2dbfd6de-0fea-4225-a306-5e3e0bddd7c3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:26.061479 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-3acad212-e0d5-4dab-a10b-ab96b429fded req-2f60a09d-19e5-4a9a-91a6-4021c79dcd88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eacc5386-d3bd-4440-8275-077517fbd610", "name": "network-vif-plugged", "status": "completed", "tag": "5c20a7ba-abbd-421f-82b7-17fb3d02b378"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:26.063372 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:46:26.063372 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:46:26.077648 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-3acad212-e0d5-4dab-a10b-ab96b429fded req-2f60a09d-19e5-4a9a-91a6-4021c79dcd88 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:26.078088 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-3acad212-e0d5-4dab-a10b-ab96b429fded req-2f60a09d-19e5-4a9a-91a6-4021c79dcd88 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:26.095774 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-3acad212-e0d5-4dab-a10b-ab96b429fded req-2f60a09d-19e5-4a9a-91a6-4021c79dcd88 service nova] Creating event network-vif-plugged:5c20a7ba-abbd-421f-82b7-17fb3d02b378 for instance eacc5386-d3bd-4440-8275-077517fbd610 on hv-cinder-78239 Aug 10 03:46:26.101191 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-3acad212-e0d5-4dab-a10b-ab96b429fded req-2f60a09d-19e5-4a9a-91a6-4021c79dcd88 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043219 Aug 10 03:46:26.102349 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 605/1241] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:46:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:46:26.204010 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-45ca1284-02bb-4acc-8e4e-d18035288fbc tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:26.204819 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-45ca1284-02bb-4acc-8e4e-d18035288fbc tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:26.212179 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-45ca1284-02bb-4acc-8e4e-d18035288fbc tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:26.213378 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-45ca1284-02bb-4acc-8e4e-d18035288fbc tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:26.213679 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-45ca1284-02bb-4acc-8e4e-d18035288fbc tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:26.214319 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-45ca1284-02bb-4acc-8e4e-d18035288fbc tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:26.275390 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2dbfd6de-0fea-4225-a306-5e3e0bddd7c3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:26.293808 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2dbfd6de-0fea-4225-a306-5e3e0bddd7c3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:26.310983 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2dbfd6de-0fea-4225-a306-5e3e0bddd7c3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:26.312648 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2dbfd6de-0fea-4225-a306-5e3e0bddd7c3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1737 microversion: 2.20 time: 0.308049 Aug 10 03:46:26.313196 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 637/1242] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:26 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1737 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:26.396465 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-45ca1284-02bb-4acc-8e4e-d18035288fbc tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:26.404951 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-45ca1284-02bb-4acc-8e4e-d18035288fbc tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1266 microversion: 2.1 time: 0.205396 Aug 10 03:46:26.406044 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 606/1243] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:26 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:46:26.870379 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-953bd8da-5990-4b92-a541-14c01d796cb0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:26.870864 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-953bd8da-5990-4b92-a541-14c01d796cb0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:26.877272 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-953bd8da-5990-4b92-a541-14c01d796cb0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:26.877722 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-953bd8da-5990-4b92-a541-14c01d796cb0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:26.878645 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-953bd8da-5990-4b92-a541-14c01d796cb0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:26.878973 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-953bd8da-5990-4b92-a541-14c01d796cb0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:26.898201 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-953bd8da-5990-4b92-a541-14c01d796cb0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] HTTP exception thrown: Instance 39489822-b8f1-4176-a07f-4b84b1cd3d67 could not be found. Aug 10 03:46:26.898809 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-953bd8da-5990-4b92-a541-14c01d796cb0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Returning 404 to user: Instance 39489822-b8f1-4176-a07f-4b84b1cd3d67 could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:46:26.899633 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-953bd8da-5990-4b92-a541-14c01d796cb0 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "DELETE /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 404 len: 111 microversion: 2.1 time: 0.033627 Aug 10 03:46:26.900583 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 638/1244] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:46:26 2021] DELETE /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:46:26.912863 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e5077590-462b-4cca-a017-3fdffff887d3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:26.913637 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e5077590-462b-4cca-a017-3fdffff887d3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 39489822-b8f1-4176-a07f-4b84b1cd3d67] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:26.922071 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e5077590-462b-4cca-a017-3fdffff887d3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:26.922821 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e5077590-462b-4cca-a017-3fdffff887d3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:26.929548 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e5077590-462b-4cca-a017-3fdffff887d3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:26.929548 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e5077590-462b-4cca-a017-3fdffff887d3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:26.941962 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-e5077590-462b-4cca-a017-3fdffff887d3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] HTTP exception thrown: Instance 39489822-b8f1-4176-a07f-4b84b1cd3d67 could not be found. Aug 10 03:46:26.942559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e5077590-462b-4cca-a017-3fdffff887d3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Returning 404 to user: Instance 39489822-b8f1-4176-a07f-4b84b1cd3d67 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:46:26.943468 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e5077590-462b-4cca-a017-3fdffff887d3 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67" status: 404 len: 111 microversion: 2.1 time: 0.039110 Aug 10 03:46:26.944560 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 607/1245] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:26 2021] GET /compute/v2.1/servers/39489822-b8f1-4176-a07f-4b84b1cd3d67 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:46:27.346952 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-53de07ec-3f7a-4eca-b89d-4fcc29dc8b4b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:27.346952 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-53de07ec-3f7a-4eca-b89d-4fcc29dc8b4b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:27.369709 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-53de07ec-3f7a-4eca-b89d-4fcc29dc8b4b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:27.370751 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-53de07ec-3f7a-4eca-b89d-4fcc29dc8b4b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:27.371510 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-53de07ec-3f7a-4eca-b89d-4fcc29dc8b4b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:27.372100 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-53de07ec-3f7a-4eca-b89d-4fcc29dc8b4b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:27.433302 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c1c602ae-294f-4971-b10a-ce1c5a34f9e7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:27.434510 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c1c602ae-294f-4971-b10a-ce1c5a34f9e7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:27.445041 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1c602ae-294f-4971-b10a-ce1c5a34f9e7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:27.446786 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1c602ae-294f-4971-b10a-ce1c5a34f9e7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:27.448398 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1c602ae-294f-4971-b10a-ce1c5a34f9e7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:27.449165 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c1c602ae-294f-4971-b10a-ce1c5a34f9e7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:27.563398 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-53de07ec-3f7a-4eca-b89d-4fcc29dc8b4b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:27.585019 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-53de07ec-3f7a-4eca-b89d-4fcc29dc8b4b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:27.587407 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-53de07ec-3f7a-4eca-b89d-4fcc29dc8b4b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:27.589670 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-53de07ec-3f7a-4eca-b89d-4fcc29dc8b4b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1719 microversion: 2.20 time: 0.257476 Aug 10 03:46:27.590252 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 639/1246] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:27 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1719 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:27.614995 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c1c602ae-294f-4971-b10a-ce1c5a34f9e7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:27.623739 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c1c602ae-294f-4971-b10a-ce1c5a34f9e7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1266 microversion: 2.1 time: 0.197234 Aug 10 03:46:27.630652 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 608/1247] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:27 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:28.367218 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b86712e9-890b-43a2-9a48-88e4e669e952 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:28.368602 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b86712e9-890b-43a2-9a48-88e4e669e952 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:28.375008 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b86712e9-890b-43a2-9a48-88e4e669e952 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:28.375448 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b86712e9-890b-43a2-9a48-88e4e669e952 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:28.376376 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b86712e9-890b-43a2-9a48-88e4e669e952 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:28.376877 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b86712e9-890b-43a2-9a48-88e4e669e952 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:28.390790 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-b86712e9-890b-43a2-9a48-88e4e669e952 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] HTTP exception thrown: Instance 8b3a59e0-96ca-48a8-a62f-c6fef743ce89 could not be found. Aug 10 03:46:28.391378 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b86712e9-890b-43a2-9a48-88e4e669e952 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Returning 404 to user: Instance 8b3a59e0-96ca-48a8-a62f-c6fef743ce89 could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:46:28.392236 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b86712e9-890b-43a2-9a48-88e4e669e952 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "DELETE /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 404 len: 111 microversion: 2.1 time: 0.028888 Aug 10 03:46:28.392774 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 640/1248] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:46:28 2021] DELETE /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:46:28.400645 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a8ad8a2a-80b9-4b62-b50a-0d3740d3c920 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:28.401272 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a8ad8a2a-80b9-4b62-b50a-0d3740d3c920 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] [instance: 8b3a59e0-96ca-48a8-a62f-c6fef743ce89] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:28.407550 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a8ad8a2a-80b9-4b62-b50a-0d3740d3c920 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:28.407875 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a8ad8a2a-80b9-4b62-b50a-0d3740d3c920 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:28.408728 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a8ad8a2a-80b9-4b62-b50a-0d3740d3c920 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:28.410379 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a8ad8a2a-80b9-4b62-b50a-0d3740d3c920 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:28.423729 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-a8ad8a2a-80b9-4b62-b50a-0d3740d3c920 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] HTTP exception thrown: Instance 8b3a59e0-96ca-48a8-a62f-c6fef743ce89 could not be found. Aug 10 03:46:28.424358 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a8ad8a2a-80b9-4b62-b50a-0d3740d3c920 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] Returning 404 to user: Instance 8b3a59e0-96ca-48a8-a62f-c6fef743ce89 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:46:28.425178 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a8ad8a2a-80b9-4b62-b50a-0d3740d3c920 tempest-AttachVolumeTestJSON-628835503 tempest-AttachVolumeTestJSON-628835503-project] 10.222.0.21 "GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89" status: 404 len: 111 microversion: 2.1 time: 0.028399 Aug 10 03:46:28.429178 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 609/1249] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:28 2021] GET /compute/v2.1/servers/8b3a59e0-96ca-48a8-a62f-c6fef743ce89 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:46:28.609440 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2b598aa0-e044-4d93-8775-1f6407749ba4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:28.610374 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2b598aa0-e044-4d93-8775-1f6407749ba4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:28.616832 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2b598aa0-e044-4d93-8775-1f6407749ba4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:28.617268 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2b598aa0-e044-4d93-8775-1f6407749ba4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:28.618061 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2b598aa0-e044-4d93-8775-1f6407749ba4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:28.618486 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2b598aa0-e044-4d93-8775-1f6407749ba4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:28.643099 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ce230cd5-3990-4241-9908-f9125be62865 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:28.645059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ce230cd5-3990-4241-9908-f9125be62865 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:28.653952 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ce230cd5-3990-4241-9908-f9125be62865 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:28.654392 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ce230cd5-3990-4241-9908-f9125be62865 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:28.655244 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ce230cd5-3990-4241-9908-f9125be62865 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:28.655627 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ce230cd5-3990-4241-9908-f9125be62865 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:28.876684 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2b598aa0-e044-4d93-8775-1f6407749ba4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:28.887882 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2b598aa0-e044-4d93-8775-1f6407749ba4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:28.890125 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2b598aa0-e044-4d93-8775-1f6407749ba4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:28.891538 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2b598aa0-e044-4d93-8775-1f6407749ba4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1719 microversion: 2.20 time: 0.286057 Aug 10 03:46:28.892266 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 641/1250] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:28 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1719 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:28.898658 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ce230cd5-3990-4241-9908-f9125be62865 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:28.910927 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ce230cd5-3990-4241-9908-f9125be62865 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1454 microversion: 2.1 time: 0.271580 Aug 10 03:46:28.911537 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 610/1251] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:28 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1454 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:46:28.927368 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-70d8f007-6eae-48dd-b4a6-2868fae4ebe9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:28.927983 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-70d8f007-6eae-48dd-b4a6-2868fae4ebe9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:28.933959 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-70d8f007-6eae-48dd-b4a6-2868fae4ebe9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:28.934408 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-70d8f007-6eae-48dd-b4a6-2868fae4ebe9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:28.935180 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-70d8f007-6eae-48dd-b4a6-2868fae4ebe9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:28.935615 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-70d8f007-6eae-48dd-b4a6-2868fae4ebe9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:29.145785 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-70d8f007-6eae-48dd-b4a6-2868fae4ebe9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:29.156047 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-70d8f007-6eae-48dd-b4a6-2868fae4ebe9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1454 microversion: 2.1 time: 0.232361 Aug 10 03:46:29.157362 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 642/1252] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:46:28 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1454 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:46:29.661406 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-bc55c90b-6814-4bec-abf9-f3e7238e30c4 req-1c84cff1-683e-425e-9dfe-b7aa32a11eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c37790e-ad20-4784-b0f0-20babcf19223", "name": "network-vif-unplugged", "status": "completed", "tag": "638e6702-b0f3-46b1-b6c2-197d8b06363d"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:29.663439 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:46:29.663439 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:46:29.676735 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-bc55c90b-6814-4bec-abf9-f3e7238e30c4 req-1c84cff1-683e-425e-9dfe-b7aa32a11eb4 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:29.677258 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-bc55c90b-6814-4bec-abf9-f3e7238e30c4 req-1c84cff1-683e-425e-9dfe-b7aa32a11eb4 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:29.689739 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-bc55c90b-6814-4bec-abf9-f3e7238e30c4 req-1c84cff1-683e-425e-9dfe-b7aa32a11eb4 service nova] Creating event network-vif-unplugged:638e6702-b0f3-46b1-b6c2-197d8b06363d for instance 5c37790e-ad20-4784-b0f0-20babcf19223 on hv-cinder-78239 Aug 10 03:46:29.694848 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-bc55c90b-6814-4bec-abf9-f3e7238e30c4 req-1c84cff1-683e-425e-9dfe-b7aa32a11eb4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037609 Aug 10 03:46:29.696701 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 611/1253] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:46:29 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:46:29.914900 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2a7001ad-3c81-4218-8dbe-45fafcc3ccd1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:29.916111 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2a7001ad-3c81-4218-8dbe-45fafcc3ccd1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:29.924809 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2a7001ad-3c81-4218-8dbe-45fafcc3ccd1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:29.932646 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2a7001ad-3c81-4218-8dbe-45fafcc3ccd1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:29.933755 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2a7001ad-3c81-4218-8dbe-45fafcc3ccd1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:29.934417 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2a7001ad-3c81-4218-8dbe-45fafcc3ccd1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:30.411920 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2a7001ad-3c81-4218-8dbe-45fafcc3ccd1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:30.421151 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2a7001ad-3c81-4218-8dbe-45fafcc3ccd1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:30.422716 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2a7001ad-3c81-4218-8dbe-45fafcc3ccd1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:30.423978 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2a7001ad-3c81-4218-8dbe-45fafcc3ccd1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1722 microversion: 2.20 time: 0.513191 Aug 10 03:46:30.424922 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 643/1254] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:29 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1722 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:30.444060 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0cd35586-c770-4166-908b-d2b44af257c6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "701c7825-abdb-498d-89c2-3143673b22dc"}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:30.445159 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0cd35586-c770-4166-908b-d2b44af257c6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:30.452344 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0cd35586-c770-4166-908b-d2b44af257c6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:30.453041 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0cd35586-c770-4166-908b-d2b44af257c6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:30.454002 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0cd35586-c770-4166-908b-d2b44af257c6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:30.454586 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0cd35586-c770-4166-908b-d2b44af257c6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:31.788625 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0cd35586-c770-4166-908b-d2b44af257c6 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.349649 Aug 10 03:46:31.789276 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 612/1255] 10.222.0.21 () {62 vars in 1364 bytes} [Tue Aug 10 03:46:30 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/os-volume_attachments => generated 188 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 03:46:31.925185 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b750a94f-3927-464b-b000-f2ae35e28df8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:31.925771 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b750a94f-3927-464b-b000-f2ae35e28df8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:31.936333 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b750a94f-3927-464b-b000-f2ae35e28df8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:31.937007 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b750a94f-3927-464b-b000-f2ae35e28df8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:31.939170 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b750a94f-3927-464b-b000-f2ae35e28df8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:31.939868 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b750a94f-3927-464b-b000-f2ae35e28df8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:32.995071 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b750a94f-3927-464b-b000-f2ae35e28df8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/os-volume_attachments/701c7825-abdb-498d-89c2-3143673b22dc" status: 202 len: 0 microversion: 2.20 time: 1.074392 Aug 10 03:46:32.998738 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 644/1256] 10.222.0.21 () {60 vars in 1457 bytes} [Tue Aug 10 03:46:31 2021] DELETE /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/os-volume_attachments/701c7825-abdb-498d-89c2-3143673b22dc => generated 0 bytes in 1076 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:46:33.042941 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-21e3f80d-cd0d-4ef3-9a04-0bdb26734948 req-ebfb55ee-42dd-464b-b40b-c315c6b89e18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eacc5386-d3bd-4440-8275-077517fbd610", "tag": "5c20a7ba-abbd-421f-82b7-17fb3d02b378"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:33.045141 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:46:33.045141 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:46:33.055808 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-21e3f80d-cd0d-4ef3-9a04-0bdb26734948 req-ebfb55ee-42dd-464b-b40b-c315c6b89e18 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:33.056260 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-21e3f80d-cd0d-4ef3-9a04-0bdb26734948 req-ebfb55ee-42dd-464b-b40b-c315c6b89e18 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:33.067824 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-21e3f80d-cd0d-4ef3-9a04-0bdb26734948 req-ebfb55ee-42dd-464b-b40b-c315c6b89e18 service nova] Creating event network-changed:5c20a7ba-abbd-421f-82b7-17fb3d02b378 for instance eacc5386-d3bd-4440-8275-077517fbd610 on hv-cinder-78239 Aug 10 03:46:33.075891 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-21e3f80d-cd0d-4ef3-9a04-0bdb26734948 req-ebfb55ee-42dd-464b-b40b-c315c6b89e18 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036440 Aug 10 03:46:33.080494 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 613/1257] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:46:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:46:33.147382 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ef1a0d27-82b4-48af-95b3-686f48d51f75 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:33.148071 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ef1a0d27-82b4-48af-95b3-686f48d51f75 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:33.154542 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ef1a0d27-82b4-48af-95b3-686f48d51f75 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:33.155251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ef1a0d27-82b4-48af-95b3-686f48d51f75 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:33.156325 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ef1a0d27-82b4-48af-95b3-686f48d51f75 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:33.156999 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ef1a0d27-82b4-48af-95b3-686f48d51f75 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:33.471067 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ef1a0d27-82b4-48af-95b3-686f48d51f75 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action" status: 202 len: 0 microversion: 2.20 time: 0.324615 Aug 10 03:46:33.471708 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 645/1258] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 10 03:46:33 2021] POST /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:46:33.482224 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-80fe3a74-fd88-467e-a0ae-368a19bb1515 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:33.482932 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-80fe3a74-fd88-467e-a0ae-368a19bb1515 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:33.497217 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80fe3a74-fd88-467e-a0ae-368a19bb1515 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:33.497667 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80fe3a74-fd88-467e-a0ae-368a19bb1515 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:33.501922 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80fe3a74-fd88-467e-a0ae-368a19bb1515 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:33.501922 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-80fe3a74-fd88-467e-a0ae-368a19bb1515 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:33.806867 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-80fe3a74-fd88-467e-a0ae-368a19bb1515 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:33.819348 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-80fe3a74-fd88-467e-a0ae-368a19bb1515 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:33.820955 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-80fe3a74-fd88-467e-a0ae-368a19bb1515 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:33.822099 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-80fe3a74-fd88-467e-a0ae-368a19bb1515 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1670 microversion: 2.20 time: 0.345947 Aug 10 03:46:33.824297 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 614/1259] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:33 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1670 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:34.843351 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-86e25ea1-77f2-4a2f-b6d5-60669f89b2dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:34.844517 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-86e25ea1-77f2-4a2f-b6d5-60669f89b2dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:34.850461 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-86e25ea1-77f2-4a2f-b6d5-60669f89b2dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:34.850901 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-86e25ea1-77f2-4a2f-b6d5-60669f89b2dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:34.851672 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-86e25ea1-77f2-4a2f-b6d5-60669f89b2dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:34.852714 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-86e25ea1-77f2-4a2f-b6d5-60669f89b2dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:34.975206 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-86e25ea1-77f2-4a2f-b6d5-60669f89b2dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:34.983486 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-86e25ea1-77f2-4a2f-b6d5-60669f89b2dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:34.985092 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-86e25ea1-77f2-4a2f-b6d5-60669f89b2dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:34.986214 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-86e25ea1-77f2-4a2f-b6d5-60669f89b2dc tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1670 microversion: 2.20 time: 0.146784 Aug 10 03:46:34.986761 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 646/1260] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:34 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1670 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:36.003733 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a0e88925-b3b9-448b-a2ba-57cde5b94ab3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:36.004480 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a0e88925-b3b9-448b-a2ba-57cde5b94ab3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:36.011147 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a0e88925-b3b9-448b-a2ba-57cde5b94ab3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:36.011591 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a0e88925-b3b9-448b-a2ba-57cde5b94ab3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:36.012410 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a0e88925-b3b9-448b-a2ba-57cde5b94ab3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:36.012845 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a0e88925-b3b9-448b-a2ba-57cde5b94ab3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:36.140154 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a0e88925-b3b9-448b-a2ba-57cde5b94ab3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:36.147860 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a0e88925-b3b9-448b-a2ba-57cde5b94ab3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:36.149890 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a0e88925-b3b9-448b-a2ba-57cde5b94ab3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:36.151015 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a0e88925-b3b9-448b-a2ba-57cde5b94ab3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.150993 Aug 10 03:46:36.151568 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 615/1261] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:35 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:37.169163 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b2f380eb-d582-43c6-b707-3201c1f066a3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:37.169769 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b2f380eb-d582-43c6-b707-3201c1f066a3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:37.175661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b2f380eb-d582-43c6-b707-3201c1f066a3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:37.176106 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b2f380eb-d582-43c6-b707-3201c1f066a3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:37.176930 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b2f380eb-d582-43c6-b707-3201c1f066a3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:37.177358 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b2f380eb-d582-43c6-b707-3201c1f066a3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:37.312894 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b2f380eb-d582-43c6-b707-3201c1f066a3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:37.321709 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b2f380eb-d582-43c6-b707-3201c1f066a3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:37.323201 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-b2f380eb-d582-43c6-b707-3201c1f066a3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:37.324598 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b2f380eb-d582-43c6-b707-3201c1f066a3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.159263 Aug 10 03:46:37.325144 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 647/1262] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:37 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:38.343195 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ef793431-21ed-450a-b8ab-17344525038f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:38.343824 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ef793431-21ed-450a-b8ab-17344525038f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:38.350062 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ef793431-21ed-450a-b8ab-17344525038f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:38.350498 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ef793431-21ed-450a-b8ab-17344525038f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:38.351270 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ef793431-21ed-450a-b8ab-17344525038f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:38.351693 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ef793431-21ed-450a-b8ab-17344525038f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:38.478630 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ef793431-21ed-450a-b8ab-17344525038f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:38.487070 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ef793431-21ed-450a-b8ab-17344525038f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:38.488595 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ef793431-21ed-450a-b8ab-17344525038f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:38.489981 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ef793431-21ed-450a-b8ab-17344525038f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.150591 Aug 10 03:46:38.490709 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 616/1263] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:38 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:39.509056 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a76d9514-b69f-416f-b3f8-3286e00330c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:39.509653 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a76d9514-b69f-416f-b3f8-3286e00330c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:39.516362 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a76d9514-b69f-416f-b3f8-3286e00330c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:39.516833 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a76d9514-b69f-416f-b3f8-3286e00330c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:39.517735 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a76d9514-b69f-416f-b3f8-3286e00330c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:39.518160 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a76d9514-b69f-416f-b3f8-3286e00330c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:39.660174 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a76d9514-b69f-416f-b3f8-3286e00330c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:39.670058 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a76d9514-b69f-416f-b3f8-3286e00330c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:39.671712 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a76d9514-b69f-416f-b3f8-3286e00330c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:39.672997 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a76d9514-b69f-416f-b3f8-3286e00330c0 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.168420 Aug 10 03:46:39.673646 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 648/1264] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:39 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:40.692847 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-9d6b9929-456e-46b0-8ab0-3fc59ebb2cca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:40.693568 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-9d6b9929-456e-46b0-8ab0-3fc59ebb2cca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:40.700350 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9d6b9929-456e-46b0-8ab0-3fc59ebb2cca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:40.700806 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9d6b9929-456e-46b0-8ab0-3fc59ebb2cca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:40.701621 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9d6b9929-456e-46b0-8ab0-3fc59ebb2cca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:40.702058 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9d6b9929-456e-46b0-8ab0-3fc59ebb2cca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:40.838413 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9d6b9929-456e-46b0-8ab0-3fc59ebb2cca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:40.845667 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9d6b9929-456e-46b0-8ab0-3fc59ebb2cca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:40.847186 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9d6b9929-456e-46b0-8ab0-3fc59ebb2cca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:40.848359 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-9d6b9929-456e-46b0-8ab0-3fc59ebb2cca tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.160318 Aug 10 03:46:40.848910 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 617/1265] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:40 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:41.866413 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-94b3f4f4-3440-4f66-8fe4-b082601a8114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:41.867009 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-94b3f4f4-3440-4f66-8fe4-b082601a8114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:41.873021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94b3f4f4-3440-4f66-8fe4-b082601a8114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:41.873457 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94b3f4f4-3440-4f66-8fe4-b082601a8114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:41.874217 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94b3f4f4-3440-4f66-8fe4-b082601a8114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:41.874640 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-94b3f4f4-3440-4f66-8fe4-b082601a8114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:42.004899 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-94b3f4f4-3440-4f66-8fe4-b082601a8114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:42.012715 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-94b3f4f4-3440-4f66-8fe4-b082601a8114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:42.014195 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-94b3f4f4-3440-4f66-8fe4-b082601a8114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:42.015460 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-94b3f4f4-3440-4f66-8fe4-b082601a8114 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.152759 Aug 10 03:46:42.016254 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 649/1266] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:41 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:43.033179 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-03ee2413-c58c-43b8-baa0-70a12e59e2f1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:43.033789 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-03ee2413-c58c-43b8-baa0-70a12e59e2f1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:43.039933 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-03ee2413-c58c-43b8-baa0-70a12e59e2f1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:43.040408 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-03ee2413-c58c-43b8-baa0-70a12e59e2f1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:43.041185 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-03ee2413-c58c-43b8-baa0-70a12e59e2f1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:43.041615 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-03ee2413-c58c-43b8-baa0-70a12e59e2f1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:43.174661 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-03ee2413-c58c-43b8-baa0-70a12e59e2f1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:43.183095 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-03ee2413-c58c-43b8-baa0-70a12e59e2f1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:43.184615 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-03ee2413-c58c-43b8-baa0-70a12e59e2f1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:43.185757 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-03ee2413-c58c-43b8-baa0-70a12e59e2f1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.156463 Aug 10 03:46:43.186310 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 618/1267] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:43 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:44.202702 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-76310d7a-e431-4fef-9165-7e3b35c6b303 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:44.203349 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-76310d7a-e431-4fef-9165-7e3b35c6b303 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:44.209220 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-76310d7a-e431-4fef-9165-7e3b35c6b303 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:44.209658 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-76310d7a-e431-4fef-9165-7e3b35c6b303 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:44.210417 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-76310d7a-e431-4fef-9165-7e3b35c6b303 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:44.210846 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-76310d7a-e431-4fef-9165-7e3b35c6b303 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:44.337247 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-76310d7a-e431-4fef-9165-7e3b35c6b303 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:44.345362 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-76310d7a-e431-4fef-9165-7e3b35c6b303 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:44.347192 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-76310d7a-e431-4fef-9165-7e3b35c6b303 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:44.348000 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-76310d7a-e431-4fef-9165-7e3b35c6b303 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.149086 Aug 10 03:46:44.348599 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 650/1268] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:44 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:45.366623 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-58e253f4-e126-44c3-ad4e-9f08824066be tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:45.367195 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-58e253f4-e126-44c3-ad4e-9f08824066be tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:45.374274 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-58e253f4-e126-44c3-ad4e-9f08824066be tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:45.381547 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-58e253f4-e126-44c3-ad4e-9f08824066be tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:45.381547 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-58e253f4-e126-44c3-ad4e-9f08824066be tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:45.381547 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-58e253f4-e126-44c3-ad4e-9f08824066be tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:45.501002 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-58e253f4-e126-44c3-ad4e-9f08824066be tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:45.509053 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-58e253f4-e126-44c3-ad4e-9f08824066be tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:45.510534 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-58e253f4-e126-44c3-ad4e-9f08824066be tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:45.511754 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-58e253f4-e126-44c3-ad4e-9f08824066be tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.149141 Aug 10 03:46:45.512699 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 619/1269] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:45 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:46.530147 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-7a873790-715c-4117-a176-58bdeca99e76 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:46.530777 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-7a873790-715c-4117-a176-58bdeca99e76 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:46.536704 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7a873790-715c-4117-a176-58bdeca99e76 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:46.537152 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7a873790-715c-4117-a176-58bdeca99e76 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:46.538139 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7a873790-715c-4117-a176-58bdeca99e76 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:46.538415 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7a873790-715c-4117-a176-58bdeca99e76 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:46.662024 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-7a873790-715c-4117-a176-58bdeca99e76 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:46.670512 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-7a873790-715c-4117-a176-58bdeca99e76 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:46.672250 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-7a873790-715c-4117-a176-58bdeca99e76 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:46.673284 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-7a873790-715c-4117-a176-58bdeca99e76 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.146904 Aug 10 03:46:46.673829 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 651/1270] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:46 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:47.692528 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a05b0646-46e9-484f-9b83-ab8310b8537c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:47.693724 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a05b0646-46e9-484f-9b83-ab8310b8537c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:47.700666 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a05b0646-46e9-484f-9b83-ab8310b8537c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:47.701110 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a05b0646-46e9-484f-9b83-ab8310b8537c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:47.702048 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a05b0646-46e9-484f-9b83-ab8310b8537c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:47.702680 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a05b0646-46e9-484f-9b83-ab8310b8537c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:47.837672 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a05b0646-46e9-484f-9b83-ab8310b8537c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:47.848767 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a05b0646-46e9-484f-9b83-ab8310b8537c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:47.850330 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-a05b0646-46e9-484f-9b83-ab8310b8537c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:47.852105 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a05b0646-46e9-484f-9b83-ab8310b8537c tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.163348 Aug 10 03:46:47.852778 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 620/1271] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:47 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:48.869561 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-aaebc51a-5785-4904-baa4-0c6c405f6a21 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:48.870160 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-aaebc51a-5785-4904-baa4-0c6c405f6a21 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:48.876156 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aaebc51a-5785-4904-baa4-0c6c405f6a21 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:48.876635 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aaebc51a-5785-4904-baa4-0c6c405f6a21 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:48.877408 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aaebc51a-5785-4904-baa4-0c6c405f6a21 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:48.877843 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aaebc51a-5785-4904-baa4-0c6c405f6a21 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:49.007135 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-aaebc51a-5785-4904-baa4-0c6c405f6a21 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:49.015554 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-aaebc51a-5785-4904-baa4-0c6c405f6a21 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:49.017145 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-aaebc51a-5785-4904-baa4-0c6c405f6a21 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:49.018284 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-aaebc51a-5785-4904-baa4-0c6c405f6a21 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.152528 Aug 10 03:46:49.018834 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 652/1272] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:48 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:50.037073 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b0b5de49-5a9a-45fa-9c1c-5e65b947b617 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:50.037681 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b0b5de49-5a9a-45fa-9c1c-5e65b947b617 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:50.043521 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b0b5de49-5a9a-45fa-9c1c-5e65b947b617 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:50.043956 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b0b5de49-5a9a-45fa-9c1c-5e65b947b617 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:50.044752 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b0b5de49-5a9a-45fa-9c1c-5e65b947b617 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:50.045186 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b0b5de49-5a9a-45fa-9c1c-5e65b947b617 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:50.163307 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b0b5de49-5a9a-45fa-9c1c-5e65b947b617 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:50.171159 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b0b5de49-5a9a-45fa-9c1c-5e65b947b617 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:50.172681 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-b0b5de49-5a9a-45fa-9c1c-5e65b947b617 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:50.173840 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b0b5de49-5a9a-45fa-9c1c-5e65b947b617 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.140480 Aug 10 03:46:50.174386 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 621/1273] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:50 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:51.191687 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-f86c60c1-0240-4237-9229-97f46caf7da3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:51.192315 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-f86c60c1-0240-4237-9229-97f46caf7da3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:51.198118 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f86c60c1-0240-4237-9229-97f46caf7da3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:51.198558 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f86c60c1-0240-4237-9229-97f46caf7da3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:51.199301 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f86c60c1-0240-4237-9229-97f46caf7da3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:51.199723 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-f86c60c1-0240-4237-9229-97f46caf7da3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:51.319400 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f86c60c1-0240-4237-9229-97f46caf7da3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:51.327920 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f86c60c1-0240-4237-9229-97f46caf7da3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:51.329424 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-f86c60c1-0240-4237-9229-97f46caf7da3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:51.330535 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-f86c60c1-0240-4237-9229-97f46caf7da3 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.142648 Aug 10 03:46:51.331099 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 653/1274] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:51 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:52.349117 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-9b9497a7-a749-43d5-bf43-444088be67b4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:52.349653 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-9b9497a7-a749-43d5-bf43-444088be67b4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:52.356110 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9b9497a7-a749-43d5-bf43-444088be67b4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:52.356591 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9b9497a7-a749-43d5-bf43-444088be67b4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:52.357354 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9b9497a7-a749-43d5-bf43-444088be67b4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:52.357777 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9b9497a7-a749-43d5-bf43-444088be67b4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:52.472958 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9b9497a7-a749-43d5-bf43-444088be67b4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:52.481424 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9b9497a7-a749-43d5-bf43-444088be67b4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:52.482911 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9b9497a7-a749-43d5-bf43-444088be67b4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:52.484041 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-9b9497a7-a749-43d5-bf43-444088be67b4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.138755 Aug 10 03:46:52.484623 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 622/1275] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:52 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:53.501750 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0cdc1efe-2bd1-48a4-a316-cd0c3437b4e8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:53.502349 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0cdc1efe-2bd1-48a4-a316-cd0c3437b4e8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:53.508059 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0cdc1efe-2bd1-48a4-a316-cd0c3437b4e8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:53.508806 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0cdc1efe-2bd1-48a4-a316-cd0c3437b4e8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:53.509291 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0cdc1efe-2bd1-48a4-a316-cd0c3437b4e8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:53.509718 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0cdc1efe-2bd1-48a4-a316-cd0c3437b4e8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:53.628683 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0cdc1efe-2bd1-48a4-a316-cd0c3437b4e8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:53.636874 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0cdc1efe-2bd1-48a4-a316-cd0c3437b4e8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:53.638458 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-0cdc1efe-2bd1-48a4-a316-cd0c3437b4e8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:53.639566 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0cdc1efe-2bd1-48a4-a316-cd0c3437b4e8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.141580 Aug 10 03:46:53.640102 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 654/1276] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:53 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:54.658124 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-8c862e10-1b03-4ad4-bcdd-75d75b49a0b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:54.658729 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-8c862e10-1b03-4ad4-bcdd-75d75b49a0b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:54.664954 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8c862e10-1b03-4ad4-bcdd-75d75b49a0b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:54.665392 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8c862e10-1b03-4ad4-bcdd-75d75b49a0b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:54.666212 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8c862e10-1b03-4ad4-bcdd-75d75b49a0b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:54.666638 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-8c862e10-1b03-4ad4-bcdd-75d75b49a0b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:54.788945 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-8c862e10-1b03-4ad4-bcdd-75d75b49a0b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:54.797193 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-8c862e10-1b03-4ad4-bcdd-75d75b49a0b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:54.798773 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-8c862e10-1b03-4ad4-bcdd-75d75b49a0b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:54.799928 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-8c862e10-1b03-4ad4-bcdd-75d75b49a0b8 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.145591 Aug 10 03:46:54.800516 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 623/1277] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:54 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:55.817656 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e4994fb7-73c6-40c0-9cfd-4391407d8576 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:55.818368 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e4994fb7-73c6-40c0-9cfd-4391407d8576 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:55.824254 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e4994fb7-73c6-40c0-9cfd-4391407d8576 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:55.824702 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e4994fb7-73c6-40c0-9cfd-4391407d8576 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:55.825468 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e4994fb7-73c6-40c0-9cfd-4391407d8576 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:55.825899 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e4994fb7-73c6-40c0-9cfd-4391407d8576 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:55.867828 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-bc7fa57f-ad65-4d81-aaff-7717bccbde7c req-76dce7d3-29cc-48b8-a282-667e12e5fe2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c37790e-ad20-4784-b0f0-20babcf19223", "name": "network-vif-plugged", "status": "completed", "tag": "638e6702-b0f3-46b1-b6c2-197d8b06363d"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:46:55.869488 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:46:55.869488 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:46:55.876470 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-bc7fa57f-ad65-4d81-aaff-7717bccbde7c req-76dce7d3-29cc-48b8-a282-667e12e5fe2b service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:55.876956 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-bc7fa57f-ad65-4d81-aaff-7717bccbde7c req-76dce7d3-29cc-48b8-a282-667e12e5fe2b service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:55.888281 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-bc7fa57f-ad65-4d81-aaff-7717bccbde7c req-76dce7d3-29cc-48b8-a282-667e12e5fe2b service nova] Creating event network-vif-plugged:638e6702-b0f3-46b1-b6c2-197d8b06363d for instance 5c37790e-ad20-4784-b0f0-20babcf19223 on hv-cinder-78239 Aug 10 03:46:55.893335 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-bc7fa57f-ad65-4d81-aaff-7717bccbde7c req-76dce7d3-29cc-48b8-a282-667e12e5fe2b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029025 Aug 10 03:46:55.893921 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 624/1278] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:46:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:46:55.951719 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e4994fb7-73c6-40c0-9cfd-4391407d8576 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:55.959841 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e4994fb7-73c6-40c0-9cfd-4391407d8576 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:55.961955 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e4994fb7-73c6-40c0-9cfd-4391407d8576 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:55.963115 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e4994fb7-73c6-40c0-9cfd-4391407d8576 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.149241 Aug 10 03:46:55.963662 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 655/1279] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:55 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:56.981719 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0682c4a6-9baa-4ab2-8941-dd94a68a7c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:56.982409 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0682c4a6-9baa-4ab2-8941-dd94a68a7c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:56.988366 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0682c4a6-9baa-4ab2-8941-dd94a68a7c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:56.988801 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0682c4a6-9baa-4ab2-8941-dd94a68a7c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:56.989552 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0682c4a6-9baa-4ab2-8941-dd94a68a7c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:56.990055 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0682c4a6-9baa-4ab2-8941-dd94a68a7c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:57.112272 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0682c4a6-9baa-4ab2-8941-dd94a68a7c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:57.118208 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0682c4a6-9baa-4ab2-8941-dd94a68a7c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:57.119711 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0682c4a6-9baa-4ab2-8941-dd94a68a7c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:57.120884 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0682c4a6-9baa-4ab2-8941-dd94a68a7c6e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.143449 Aug 10 03:46:57.121434 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 625/1280] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:56 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:58.139761 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-cd0babbe-a145-440f-aaaf-7bb25b85bce5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:58.140402 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-cd0babbe-a145-440f-aaaf-7bb25b85bce5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:58.146391 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cd0babbe-a145-440f-aaaf-7bb25b85bce5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:58.146874 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cd0babbe-a145-440f-aaaf-7bb25b85bce5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:58.147652 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cd0babbe-a145-440f-aaaf-7bb25b85bce5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:58.148087 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-cd0babbe-a145-440f-aaaf-7bb25b85bce5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:58.278931 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-cd0babbe-a145-440f-aaaf-7bb25b85bce5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:58.286913 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-cd0babbe-a145-440f-aaaf-7bb25b85bce5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:58.288387 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-cd0babbe-a145-440f-aaaf-7bb25b85bce5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:58.289506 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-cd0babbe-a145-440f-aaaf-7bb25b85bce5 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1728 microversion: 2.20 time: 0.154009 Aug 10 03:46:58.290051 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 656/1281] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:58 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:46:59.307080 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d6bbdc06-77f3-4674-b27f-d990e5ef08a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:46:59.307691 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d6bbdc06-77f3-4674-b27f-d990e5ef08a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:46:59.313402 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d6bbdc06-77f3-4674-b27f-d990e5ef08a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:59.313849 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d6bbdc06-77f3-4674-b27f-d990e5ef08a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:59.314608 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d6bbdc06-77f3-4674-b27f-d990e5ef08a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:46:59.315052 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d6bbdc06-77f3-4674-b27f-d990e5ef08a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:46:59.440023 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d6bbdc06-77f3-4674-b27f-d990e5ef08a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:59.449993 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d6bbdc06-77f3-4674-b27f-d990e5ef08a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:59.451706 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d6bbdc06-77f3-4674-b27f-d990e5ef08a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:46:59.453190 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d6bbdc06-77f3-4674-b27f-d990e5ef08a1 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1715 microversion: 2.20 time: 0.150169 Aug 10 03:46:59.453879 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 626/1282] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:46:59 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:47:37.829989 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-54e14f68-44d2-4fef-af27-76368dd76783 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:37.829989 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-54e14f68-44d2-4fef-af27-76368dd76783 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:37.835842 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54e14f68-44d2-4fef-af27-76368dd76783 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:37.836408 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54e14f68-44d2-4fef-af27-76368dd76783 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:37.837242 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54e14f68-44d2-4fef-af27-76368dd76783 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:37.837741 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-54e14f68-44d2-4fef-af27-76368dd76783 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:37.868384 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-54e14f68-44d2-4fef-af27-76368dd76783 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044538 Aug 10 03:47:37.870993 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 657/1283] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 10 03:47:37 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:47:37.929275 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ae4cf50e-3601-4dcd-a04e-906932e6bebf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:37.934029 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ae4cf50e-3601-4dcd-a04e-906932e6bebf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:37.935834 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ae4cf50e-3601-4dcd-a04e-906932e6bebf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:37.936331 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ae4cf50e-3601-4dcd-a04e-906932e6bebf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:37.937099 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ae4cf50e-3601-4dcd-a04e-906932e6bebf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:37.937542 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ae4cf50e-3601-4dcd-a04e-906932e6bebf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:37.964089 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ae4cf50e-3601-4dcd-a04e-906932e6bebf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Going to try to terminate instance {{(pid=108440) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:47:38.296822 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ae4cf50e-3601-4dcd-a04e-906932e6bebf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 204 len: 0 microversion: 2.20 time: 0.370759 Aug 10 03:47:38.297738 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 627/1284] 10.222.0.21 () {60 vars in 1280 bytes} [Tue Aug 10 03:47:37 2021] DELETE /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 03:47:38.306624 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-5faef6aa-e227-4331-9451-ab0ee78e5aaf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:38.307234 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-5faef6aa-e227-4331-9451-ab0ee78e5aaf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:38.312987 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5faef6aa-e227-4331-9451-ab0ee78e5aaf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:38.313426 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5faef6aa-e227-4331-9451-ab0ee78e5aaf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:38.314191 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5faef6aa-e227-4331-9451-ab0ee78e5aaf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:38.314619 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-5faef6aa-e227-4331-9451-ab0ee78e5aaf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:38.434590 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-5faef6aa-e227-4331-9451-ab0ee78e5aaf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:38.442416 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-5faef6aa-e227-4331-9451-ab0ee78e5aaf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:38.443947 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-5faef6aa-e227-4331-9451-ab0ee78e5aaf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:38.445103 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-5faef6aa-e227-4331-9451-ab0ee78e5aaf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.142402 Aug 10 03:47:38.445661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 658/1285] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:47:38 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:47:39.464121 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f64a5571-55b4-494f-b122-cee59285894e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:39.464835 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f64a5571-55b4-494f-b122-cee59285894e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:39.470501 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f64a5571-55b4-494f-b122-cee59285894e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:39.470937 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f64a5571-55b4-494f-b122-cee59285894e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:39.471690 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f64a5571-55b4-494f-b122-cee59285894e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:39.472111 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f64a5571-55b4-494f-b122-cee59285894e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:39.598129 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f64a5571-55b4-494f-b122-cee59285894e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:39.606237 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f64a5571-55b4-494f-b122-cee59285894e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:39.607729 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f64a5571-55b4-494f-b122-cee59285894e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:39.608888 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f64a5571-55b4-494f-b122-cee59285894e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1721 microversion: 2.20 time: 0.149417 Aug 10 03:47:39.609450 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 628/1286] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:47:39 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:47:40.626890 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-7313f7b4-f687-437a-93e2-f05b34793b8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:40.627500 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-7313f7b4-f687-437a-93e2-f05b34793b8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:40.633873 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7313f7b4-f687-437a-93e2-f05b34793b8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:40.634314 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7313f7b4-f687-437a-93e2-f05b34793b8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:40.638345 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7313f7b4-f687-437a-93e2-f05b34793b8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:40.638345 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7313f7b4-f687-437a-93e2-f05b34793b8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:40.734108 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-7313f7b4-f687-437a-93e2-f05b34793b8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:40.734108 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-7313f7b4-f687-437a-93e2-f05b34793b8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:40.735695 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-7313f7b4-f687-437a-93e2-f05b34793b8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:40.735695 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-7313f7b4-f687-437a-93e2-f05b34793b8f tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1655 microversion: 2.20 time: 0.101512 Aug 10 03:47:40.735695 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 659/1287] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:47:40 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1655 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:47:40.945154 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-5c60ca3b-482a-4db1-837c-b4d9100c18f2 req-1259f79f-b24f-4424-a8fe-23759ee0d211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c37790e-ad20-4784-b0f0-20babcf19223", "name": "network-vif-deleted", "tag": "638e6702-b0f3-46b1-b6c2-197d8b06363d"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:47:40.946713 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:47:40.946713 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:47:40.953962 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-5c60ca3b-482a-4db1-837c-b4d9100c18f2 req-1259f79f-b24f-4424-a8fe-23759ee0d211 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:40.954397 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-5c60ca3b-482a-4db1-837c-b4d9100c18f2 req-1259f79f-b24f-4424-a8fe-23759ee0d211 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:40.968559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-5c60ca3b-482a-4db1-837c-b4d9100c18f2 req-1259f79f-b24f-4424-a8fe-23759ee0d211 service nova] Creating event network-vif-deleted:638e6702-b0f3-46b1-b6c2-197d8b06363d for instance 5c37790e-ad20-4784-b0f0-20babcf19223 on hv-cinder-78239 Aug 10 03:47:40.979474 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-5c60ca3b-482a-4db1-837c-b4d9100c18f2 req-1259f79f-b24f-4424-a8fe-23759ee0d211 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037908 Aug 10 03:47:40.980343 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 629/1288] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:47:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:47:41.743524 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-43bf7e92-ab27-4881-ad0c-83102e30f59e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:41.744126 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-43bf7e92-ab27-4881-ad0c-83102e30f59e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:41.750338 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-43bf7e92-ab27-4881-ad0c-83102e30f59e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:41.750833 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-43bf7e92-ab27-4881-ad0c-83102e30f59e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:41.751680 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-43bf7e92-ab27-4881-ad0c-83102e30f59e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:41.752156 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-43bf7e92-ab27-4881-ad0c-83102e30f59e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:41.784859 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-43bf7e92-ab27-4881-ad0c-83102e30f59e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:41.785296 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-43bf7e92-ab27-4881-ad0c-83102e30f59e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:41.785745 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-43bf7e92-ab27-4881-ad0c-83102e30f59e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lazy-loading 'fault' on Instance uuid 5c37790e-ad20-4784-b0f0-20babcf19223 {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:47:41.829117 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-43bf7e92-ab27-4881-ad0c-83102e30f59e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:41.837190 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-43bf7e92-ab27-4881-ad0c-83102e30f59e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:41.838659 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-43bf7e92-ab27-4881-ad0c-83102e30f59e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84e7b0c8858f4616ad809fb025ffa9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098d020e6c2a497a939e7c54eb5cc81a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:41.839773 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-43bf7e92-ab27-4881-ad0c-83102e30f59e tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 200 len: 1370 microversion: 2.20 time: 0.100781 Aug 10 03:47:41.840331 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 660/1289] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:47:41 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 1370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 03:47:42.857579 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-30f46613-db93-4d0e-8f38-1293306f6d9b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:42.876344 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-30f46613-db93-4d0e-8f38-1293306f6d9b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:42.876344 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-30f46613-db93-4d0e-8f38-1293306f6d9b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:42.876344 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-30f46613-db93-4d0e-8f38-1293306f6d9b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:42.876344 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-30f46613-db93-4d0e-8f38-1293306f6d9b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:42.876721 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-30f46613-db93-4d0e-8f38-1293306f6d9b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:42.879210 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-30f46613-db93-4d0e-8f38-1293306f6d9b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] HTTP exception thrown: Instance 5c37790e-ad20-4784-b0f0-20babcf19223 could not be found. Aug 10 03:47:42.879809 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-30f46613-db93-4d0e-8f38-1293306f6d9b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Returning 404 to user: Instance 5c37790e-ad20-4784-b0f0-20babcf19223 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:47:42.880708 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-30f46613-db93-4d0e-8f38-1293306f6d9b tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 404 len: 111 microversion: 2.20 time: 0.027391 Aug 10 03:47:42.881212 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 630/1290] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 10 03:47:42 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 03:47:42.890033 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-38d11540-08a0-4fb0-9208-dace377b43a4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '.version_select at 0x7f9793ed9d30>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:42.971033 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-38d11540-08a0-4fb0-9208-dace377b43a4 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-76363245" status: 204 len: 0 microversion: 2.20 time: 0.084646 Aug 10 03:47:42.977301 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 661/1291] 10.222.0.21 () {60 vars in 1256 bytes} [Tue Aug 10 03:47:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-76363245 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 03:47:45.008949 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a62b07f1-68f9-4865-8bea-06a46f3b4ab2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:45.009519 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a62b07f1-68f9-4865-8bea-06a46f3b4ab2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:45.011793 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-75758d96-193b-4af6-9fb1-1c74a4b5fb3e req-936deb1c-18bc-49a3-a0bb-528e3b3e0b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a89090-7d79-496b-878d-213d6f48b970", "tag": "6f883b5b-35b9-44d5-8f3d-ba0bf7b04925"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:47:45.014248 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:47:45.014248 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:47:45.015743 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a62b07f1-68f9-4865-8bea-06a46f3b4ab2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:45.016191 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a62b07f1-68f9-4865-8bea-06a46f3b4ab2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:45.017054 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a62b07f1-68f9-4865-8bea-06a46f3b4ab2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:45.017493 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-a62b07f1-68f9-4865-8bea-06a46f3b4ab2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:45.023868 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-75758d96-193b-4af6-9fb1-1c74a4b5fb3e req-936deb1c-18bc-49a3-a0bb-528e3b3e0b4e service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:45.024758 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-75758d96-193b-4af6-9fb1-1c74a4b5fb3e req-936deb1c-18bc-49a3-a0bb-528e3b3e0b4e service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:45.036873 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-75758d96-193b-4af6-9fb1-1c74a4b5fb3e req-936deb1c-18bc-49a3-a0bb-528e3b3e0b4e service nova] Creating event network-changed:6f883b5b-35b9-44d5-8f3d-ba0bf7b04925 for instance 43a89090-7d79-496b-878d-213d6f48b970 on hv-cinder-78239 Aug 10 03:47:45.042681 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-75758d96-193b-4af6-9fb1-1c74a4b5fb3e req-936deb1c-18bc-49a3-a0bb-528e3b3e0b4e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035706 Aug 10 03:47:45.043838 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 662/1292] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:47:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:47:45.046695 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-a62b07f1-68f9-4865-8bea-06a46f3b4ab2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Going to try to terminate instance {{(pid=108440) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:47:45.208449 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b97493ba-19c9-4f7d-9c86-d88a03815dfe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:45.209037 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b97493ba-19c9-4f7d-9c86-d88a03815dfe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:45.215915 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b97493ba-19c9-4f7d-9c86-d88a03815dfe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:45.220144 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b97493ba-19c9-4f7d-9c86-d88a03815dfe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:45.220144 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b97493ba-19c9-4f7d-9c86-d88a03815dfe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:45.220144 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b97493ba-19c9-4f7d-9c86-d88a03815dfe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:45.232060 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-b97493ba-19c9-4f7d-9c86-d88a03815dfe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] HTTP exception thrown: Instance 5c37790e-ad20-4784-b0f0-20babcf19223 could not be found. Aug 10 03:47:45.232700 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b97493ba-19c9-4f7d-9c86-d88a03815dfe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Returning 404 to user: Instance 5c37790e-ad20-4784-b0f0-20babcf19223 could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:47:45.233546 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b97493ba-19c9-4f7d-9c86-d88a03815dfe tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 404 len: 111 microversion: 2.1 time: 0.029563 Aug 10 03:47:45.234070 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 663/1293] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:47:45 2021] DELETE /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 03:47:45.246302 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9d7158da-c111-4b07-8470-8e3466493d55 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:45.247415 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9d7158da-c111-4b07-8470-8e3466493d55 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 5c37790e-ad20-4784-b0f0-20babcf19223] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:45.253878 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9d7158da-c111-4b07-8470-8e3466493d55 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:45.254437 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9d7158da-c111-4b07-8470-8e3466493d55 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:45.255661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9d7158da-c111-4b07-8470-8e3466493d55 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:45.256342 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9d7158da-c111-4b07-8470-8e3466493d55 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:45.272700 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-9d7158da-c111-4b07-8470-8e3466493d55 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] HTTP exception thrown: Instance 5c37790e-ad20-4784-b0f0-20babcf19223 could not be found. Aug 10 03:47:45.273292 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9d7158da-c111-4b07-8470-8e3466493d55 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Returning 404 to user: Instance 5c37790e-ad20-4784-b0f0-20babcf19223 could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:47:45.283252 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9d7158da-c111-4b07-8470-8e3466493d55 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223" status: 404 len: 111 microversion: 2.1 time: 0.032831 Aug 10 03:47:45.283252 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 664/1294] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:47:45 2021] GET /compute/v2.1/servers/5c37790e-ad20-4784-b0f0-20babcf19223 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 03:47:45.450036 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a62b07f1-68f9-4865-8bea-06a46f3b4ab2 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "DELETE /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 204 len: 0 microversion: 2.1 time: 0.445391 Aug 10 03:47:45.450623 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 631/1295] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:47:45 2021] DELETE /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:47:45.458769 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2bfe5a84-0a11-4f06-854e-df1f7a598518 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:45.460337 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2bfe5a84-0a11-4f06-854e-df1f7a598518 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:45.466668 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2bfe5a84-0a11-4f06-854e-df1f7a598518 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:45.467364 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2bfe5a84-0a11-4f06-854e-df1f7a598518 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:45.468218 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2bfe5a84-0a11-4f06-854e-df1f7a598518 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:45.468839 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2bfe5a84-0a11-4f06-854e-df1f7a598518 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:45.622491 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2bfe5a84-0a11-4f06-854e-df1f7a598518 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:45.631930 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2bfe5a84-0a11-4f06-854e-df1f7a598518 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1567 microversion: 2.1 time: 0.175940 Aug 10 03:47:45.633167 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 665/1296] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:47:45 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:47:46.644552 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-37b4de89-1695-4c7d-9b8d-ba159fce4163 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:46.645142 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-37b4de89-1695-4c7d-9b8d-ba159fce4163 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:46.649435 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2aa38e51-ea62-401e-bb24-a8d0c9ad8f11 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:46.655392 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-2aa38e51-ea62-401e-bb24-a8d0c9ad8f11 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:46.655543 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-37b4de89-1695-4c7d-9b8d-ba159fce4163 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:46.655543 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-37b4de89-1695-4c7d-9b8d-ba159fce4163 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:46.655543 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-37b4de89-1695-4c7d-9b8d-ba159fce4163 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:46.655543 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-37b4de89-1695-4c7d-9b8d-ba159fce4163 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:46.655937 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2aa38e51-ea62-401e-bb24-a8d0c9ad8f11 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:46.656139 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2aa38e51-ea62-401e-bb24-a8d0c9ad8f11 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:46.656925 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2aa38e51-ea62-401e-bb24-a8d0c9ad8f11 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:46.657347 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-2aa38e51-ea62-401e-bb24-a8d0c9ad8f11 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:46.667278 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-37b4de89-1695-4c7d-9b8d-ba159fce4163 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] HTTP exception thrown: Instance 0c599984-f271-4886-be2f-73e7531f52e4 could not be found. Aug 10 03:47:46.667871 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-37b4de89-1695-4c7d-9b8d-ba159fce4163 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Returning 404 to user: Instance 0c599984-f271-4886-be2f-73e7531f52e4 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:47:46.668728 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-37b4de89-1695-4c7d-9b8d-ba159fce4163 tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "DELETE /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 404 len: 111 microversion: 2.1 time: 0.028315 Aug 10 03:47:46.669460 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 632/1297] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:47:46 2021] DELETE /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:47:46.676869 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1873964c-25d0-49d7-84cd-b3ff6e102adf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:46.680342 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-1873964c-25d0-49d7-84cd-b3ff6e102adf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] [instance: 0c599984-f271-4886-be2f-73e7531f52e4] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:46.683300 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1873964c-25d0-49d7-84cd-b3ff6e102adf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:46.683753 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1873964c-25d0-49d7-84cd-b3ff6e102adf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:46.684559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1873964c-25d0-49d7-84cd-b3ff6e102adf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:46.685120 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-1873964c-25d0-49d7-84cd-b3ff6e102adf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:46.702499 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-1873964c-25d0-49d7-84cd-b3ff6e102adf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] HTTP exception thrown: Instance 0c599984-f271-4886-be2f-73e7531f52e4 could not be found. Aug 10 03:47:46.703212 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-1873964c-25d0-49d7-84cd-b3ff6e102adf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] Returning 404 to user: Instance 0c599984-f271-4886-be2f-73e7531f52e4 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:47:46.703944 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-1873964c-25d0-49d7-84cd-b3ff6e102adf tempest-AttachVolumeShelveTestJSON-24949369 tempest-AttachVolumeShelveTestJSON-24949369-project] 10.222.0.21 "GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4" status: 404 len: 111 microversion: 2.1 time: 0.030522 Aug 10 03:47:46.704483 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 633/1298] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:47:46 2021] GET /compute/v2.1/servers/0c599984-f271-4886-be2f-73e7531f52e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 03:47:46.780664 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-2aa38e51-ea62-401e-bb24-a8d0c9ad8f11 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:46.788180 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2aa38e51-ea62-401e-bb24-a8d0c9ad8f11 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1448 microversion: 2.1 time: 0.142801 Aug 10 03:47:46.788945 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 666/1299] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:47:46 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1448 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:47:47.805825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-08cfba34-5351-4367-9b3f-6eda6d996600 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:47.807138 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-08cfba34-5351-4367-9b3f-6eda6d996600 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:47.813575 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-08cfba34-5351-4367-9b3f-6eda6d996600 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:47.815105 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-08cfba34-5351-4367-9b3f-6eda6d996600 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:47.816050 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-08cfba34-5351-4367-9b3f-6eda6d996600 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:47.816706 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-08cfba34-5351-4367-9b3f-6eda6d996600 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:48.037711 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-08cfba34-5351-4367-9b3f-6eda6d996600 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:48.045287 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-08cfba34-5351-4367-9b3f-6eda6d996600 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1448 microversion: 2.1 time: 0.243629 Aug 10 03:47:48.045844 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 634/1300] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:47:47 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1448 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:47:48.117869 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-584542fc-a62f-4191-8b1e-dc371d4369ec req-372b2f77-a05e-47b8-abaa-d8fde1d0e107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a89090-7d79-496b-878d-213d6f48b970", "name": "network-vif-deleted", "tag": "6f883b5b-35b9-44d5-8f3d-ba0bf7b04925"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:47:48.119359 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:47:48.119359 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:47:48.126017 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-584542fc-a62f-4191-8b1e-dc371d4369ec req-372b2f77-a05e-47b8-abaa-d8fde1d0e107 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:48.126449 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-584542fc-a62f-4191-8b1e-dc371d4369ec req-372b2f77-a05e-47b8-abaa-d8fde1d0e107 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:48.137104 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-584542fc-a62f-4191-8b1e-dc371d4369ec req-372b2f77-a05e-47b8-abaa-d8fde1d0e107 service nova] Creating event network-vif-deleted:6f883b5b-35b9-44d5-8f3d-ba0bf7b04925 for instance 43a89090-7d79-496b-878d-213d6f48b970 on hv-cinder-78239 Aug 10 03:47:48.141686 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-584542fc-a62f-4191-8b1e-dc371d4369ec req-372b2f77-a05e-47b8-abaa-d8fde1d0e107 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027905 Aug 10 03:47:48.142243 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 667/1301] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:47:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:47:49.062768 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-daeed880-e100-4f0a-ae22-e80ca7f3fb73 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:49.063384 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-daeed880-e100-4f0a-ae22-e80ca7f3fb73 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:49.070274 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-daeed880-e100-4f0a-ae22-e80ca7f3fb73 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:49.070687 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-daeed880-e100-4f0a-ae22-e80ca7f3fb73 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:49.071470 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-daeed880-e100-4f0a-ae22-e80ca7f3fb73 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:49.071898 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-daeed880-e100-4f0a-ae22-e80ca7f3fb73 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:49.109116 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-daeed880-e100-4f0a-ae22-e80ca7f3fb73 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:49.109555 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-daeed880-e100-4f0a-ae22-e80ca7f3fb73 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:49.110005 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.objects.instance [None req-daeed880-e100-4f0a-ae22-e80ca7f3fb73 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lazy-loading 'fault' on Instance uuid 43a89090-7d79-496b-878d-213d6f48b970 {{(pid=108440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:47:49.163638 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-daeed880-e100-4f0a-ae22-e80ca7f3fb73 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35d508678b14f2583abf9ba5ae7fb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77aab94ffcab4a8b9ad529c5a5454ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:47:49.172613 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-daeed880-e100-4f0a-ae22-e80ca7f3fb73 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 200 len: 1225 microversion: 2.1 time: 0.113506 Aug 10 03:47:49.175433 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 635/1302] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:47:49 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:47:50.201898 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6e433020-549d-4e63-8c0a-b731becc0274 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:50.202620 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6e433020-549d-4e63-8c0a-b731becc0274 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] [instance: 43a89090-7d79-496b-878d-213d6f48b970] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:47:50.210261 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6e433020-549d-4e63-8c0a-b731becc0274 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:50.210933 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6e433020-549d-4e63-8c0a-b731becc0274 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:50.211881 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6e433020-549d-4e63-8c0a-b731becc0274 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:47:50.212492 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6e433020-549d-4e63-8c0a-b731becc0274 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:47:50.228339 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-6e433020-549d-4e63-8c0a-b731becc0274 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] HTTP exception thrown: Instance 43a89090-7d79-496b-878d-213d6f48b970 could not be found. Aug 10 03:47:50.229087 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6e433020-549d-4e63-8c0a-b731becc0274 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Returning 404 to user: Instance 43a89090-7d79-496b-878d-213d6f48b970 could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:47:50.230222 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6e433020-549d-4e63-8c0a-b731becc0274 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970" status: 404 len: 111 microversion: 2.1 time: 0.039941 Aug 10 03:47:50.233097 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 668/1303] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:47:50 2021] GET /compute/v2.1/servers/43a89090-7d79-496b-878d-213d6f48b970 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:47:50.519597 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-a009f4b5-31c0-4e5f-b68a-de4deced4376 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] Calling method '.version_select at 0x7f97a4e7a5e0>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:50.605877 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-a009f4b5-31c0-4e5f-b68a-de4deced4376 tempest-TestShelveInstance-1633841862 tempest-TestShelveInstance-1633841862-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1117142228" status: 202 len: 0 microversion: 2.1 time: 0.090636 Aug 10 03:47:50.606450 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 636/1304] 10.222.0.21 () {58 vars in 1254 bytes} [Tue Aug 10 03:47:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1117142228 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:47:53.728766 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a602091a-e063-43b5-afa5-5f38aa0f08c5 tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] Action: 'create', calling method: .version_select at 0x7f9793f2edc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-287393985", "metadata": {"Type": "work"}}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:47:54.636505 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a602091a-e063-43b5-afa5-5f38aa0f08c5 tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.027181 Aug 10 03:47:54.637167 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 669/1305] 10.222.0.21 () {60 vars in 1156 bytes} [Tue Aug 10 03:47:53 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 1030 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 03:47:54.648829 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f2cd4657-3c0e-4f42-a52b-e0c0bd4b4cfd tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] Calling method '.version_select at 0x7f97a4edc160>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:54.710508 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f2cd4657-3c0e-4f42-a52b-e0c0bd4b4cfd tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/fc2033c8-5cda-426f-98fc-3555e74c7a04" status: 200 len: 352 microversion: 2.1 time: 0.059750 Aug 10 03:47:54.710508 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 637/1306] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:47:54 2021] GET /compute/v2.1/os-volumes/fc2033c8-5cda-426f-98fc-3555e74c7a04 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:47:55.716520 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d5355eef-f1b5-4026-bb52-153d9ba0130c tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] Calling method '.version_select at 0x7f9793ed93a0>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:55.769083 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d5355eef-f1b5-4026-bb52-153d9ba0130c tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/fc2033c8-5cda-426f-98fc-3555e74c7a04" status: 200 len: 353 microversion: 2.1 time: 0.056490 Aug 10 03:47:55.772707 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 670/1307] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:47:55 2021] GET /compute/v2.1/os-volumes/fc2033c8-5cda-426f-98fc-3555e74c7a04 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:47:55.782191 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7e565c74-a5da-4761-8274-b7cb1b3f8812 tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] Calling method '.version_select at 0x7f97a4edc3a0>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:55.836864 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7e565c74-a5da-4761-8274-b7cb1b3f8812 tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/fc2033c8-5cda-426f-98fc-3555e74c7a04" status: 200 len: 353 microversion: 2.1 time: 0.058873 Aug 10 03:47:55.837439 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 638/1308] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:47:55 2021] GET /compute/v2.1/os-volumes/fc2033c8-5cda-426f-98fc-3555e74c7a04 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:47:55.853843 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e98fd630-171d-4608-9eac-a532d87f42af tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] Calling method '.version_select at 0x7f9793e82a60>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:56.095250 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e98fd630-171d-4608-9eac-a532d87f42af tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/fc2033c8-5cda-426f-98fc-3555e74c7a04" status: 202 len: 0 microversion: 2.1 time: 0.245670 Aug 10 03:47:56.096015 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 671/1309] 10.222.0.21 () {58 vars in 1248 bytes} [Tue Aug 10 03:47:55 2021] DELETE /compute/v2.1/os-volumes/fc2033c8-5cda-426f-98fc-3555e74c7a04 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:47:56.104348 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d7f389b5-b573-4f23-badd-be45863e0a6b tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] Calling method '.version_select at 0x7f97a4f6c040>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:56.166006 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d7f389b5-b573-4f23-badd-be45863e0a6b tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/fc2033c8-5cda-426f-98fc-3555e74c7a04" status: 200 len: 352 microversion: 2.1 time: 0.065681 Aug 10 03:47:56.171063 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 639/1310] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:47:56 2021] GET /compute/v2.1/os-volumes/fc2033c8-5cda-426f-98fc-3555e74c7a04 => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:47:57.178828 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2b6a1316-16fc-4539-b734-82db54aba6e7 tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] Calling method '.version_select at 0x7f9793e82700>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:47:57.208755 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-2b6a1316-16fc-4539-b734-82db54aba6e7 tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] HTTP exception thrown: Volume fc2033c8-5cda-426f-98fc-3555e74c7a04 could not be found. Aug 10 03:47:57.209504 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-2b6a1316-16fc-4539-b734-82db54aba6e7 tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] Returning 404 to user: Volume fc2033c8-5cda-426f-98fc-3555e74c7a04 could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:47:57.210506 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-2b6a1316-16fc-4539-b734-82db54aba6e7 tempest-VolumesGetTestJSON-2108572170 tempest-VolumesGetTestJSON-2108572170-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/fc2033c8-5cda-426f-98fc-3555e74c7a04" status: 404 len: 109 microversion: 2.1 time: 0.036067 Aug 10 03:47:57.211146 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 672/1311] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 10 03:47:57 2021] GET /compute/v2.1/os-volumes/fc2033c8-5cda-426f-98fc-3555e74c7a04 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:48:29.597312 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cea58ddc-44b4-412e-b7e9-3663d85a488d] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 03:48:29.601399 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-bd76b76d-60b1-401d-b55a-50a8b2f4f304 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:29.608280 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-bd76b76d-60b1-401d-b55a-50a8b2f4f304 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:29.608280 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bd76b76d-60b1-401d-b55a-50a8b2f4f304 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:29.608713 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bd76b76d-60b1-401d-b55a-50a8b2f4f304 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:29.609494 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bd76b76d-60b1-401d-b55a-50a8b2f4f304 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:29.609930 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-bd76b76d-60b1-401d-b55a-50a8b2f4f304 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:29.637323 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-bd76b76d-60b1-401d-b55a-50a8b2f4f304 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Going to try to terminate instance {{(pid=108440) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:48:30.095438 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-bd76b76d-60b1-401d-b55a-50a8b2f4f304 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "DELETE /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 204 len: 0 microversion: 2.1 time: 0.499202 Aug 10 03:48:30.096065 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 640/1312] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:48:29 2021] DELETE /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:48:30.101816 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b741819f-04ee-419b-9c9f-d9493183c04f] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 03:48:30.105634 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-9a3cead3-d494-4f93-9507-b32b39a73349 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:30.106868 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-9a3cead3-d494-4f93-9507-b32b39a73349 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:30.113361 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9a3cead3-d494-4f93-9507-b32b39a73349 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:30.113844 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9a3cead3-d494-4f93-9507-b32b39a73349 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:30.114656 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9a3cead3-d494-4f93-9507-b32b39a73349 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:30.115912 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-9a3cead3-d494-4f93-9507-b32b39a73349 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:30.254041 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-9a3cead3-d494-4f93-9507-b32b39a73349 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:30.264718 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-9a3cead3-d494-4f93-9507-b32b39a73349 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1579 microversion: 2.1 time: 0.164312 Aug 10 03:48:30.276077 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 673/1313] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:30 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1579 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:31.282758 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-487e75db-b575-490b-86e7-64e87e2e797d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:31.283446 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-487e75db-b575-490b-86e7-64e87e2e797d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:31.300313 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-487e75db-b575-490b-86e7-64e87e2e797d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:31.300751 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-487e75db-b575-490b-86e7-64e87e2e797d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:31.301512 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-487e75db-b575-490b-86e7-64e87e2e797d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:31.301944 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-487e75db-b575-490b-86e7-64e87e2e797d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:31.308260 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO oslo.messaging._drivers.impl_rabbit [-] [cea58ddc-44b4-412e-b7e9-3663d85a488d] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 49098. Aug 10 03:48:31.426606 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-487e75db-b575-490b-86e7-64e87e2e797d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:31.434544 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-487e75db-b575-490b-86e7-64e87e2e797d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1579 microversion: 2.1 time: 0.155878 Aug 10 03:48:31.435105 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 641/1314] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:31 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:32.454685 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c463f4fb-0c28-4fdc-aa82-0052fe16d8b5 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:32.455391 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c463f4fb-0c28-4fdc-aa82-0052fe16d8b5 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:32.475441 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c463f4fb-0c28-4fdc-aa82-0052fe16d8b5 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:32.475891 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c463f4fb-0c28-4fdc-aa82-0052fe16d8b5 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:32.476703 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c463f4fb-0c28-4fdc-aa82-0052fe16d8b5 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:32.477145 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c463f4fb-0c28-4fdc-aa82-0052fe16d8b5 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:32.482652 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO oslo.messaging._drivers.impl_rabbit [-] [b741819f-04ee-419b-9c9f-d9493183c04f] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 49106. Aug 10 03:48:32.543862 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c463f4fb-0c28-4fdc-aa82-0052fe16d8b5 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:32.551904 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c463f4fb-0c28-4fdc-aa82-0052fe16d8b5 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1511 microversion: 2.1 time: 0.101837 Aug 10 03:48:32.552754 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 674/1315] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:32 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1511 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:32.770160 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-0673497e-c0e0-4a95-8d2b-f6582b1abc39 req-c07abc07-d6d1-4904-bac3-14733d906046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eacc5386-d3bd-4440-8275-077517fbd610", "name": "network-vif-deleted", "tag": "5c20a7ba-abbd-421f-82b7-17fb3d02b378"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:48:32.779167 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:48:32.779167 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:48:32.786364 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-0673497e-c0e0-4a95-8d2b-f6582b1abc39 req-c07abc07-d6d1-4904-bac3-14733d906046 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:32.789833 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-0673497e-c0e0-4a95-8d2b-f6582b1abc39 req-c07abc07-d6d1-4904-bac3-14733d906046 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:32.797828 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-0673497e-c0e0-4a95-8d2b-f6582b1abc39 req-c07abc07-d6d1-4904-bac3-14733d906046 service nova] Creating event network-vif-deleted:5c20a7ba-abbd-421f-82b7-17fb3d02b378 for instance eacc5386-d3bd-4440-8275-077517fbd610 on hv-cinder-78239 Aug 10 03:48:32.802550 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-0673497e-c0e0-4a95-8d2b-f6582b1abc39 req-c07abc07-d6d1-4904-bac3-14733d906046 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036223 Aug 10 03:48:32.803129 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 642/1316] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:48:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:48:33.570692 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-35eef90c-0443-4e90-a8ba-e99cc9b76011 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:33.573060 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-35eef90c-0443-4e90-a8ba-e99cc9b76011 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:33.582814 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-35eef90c-0443-4e90-a8ba-e99cc9b76011 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:33.582814 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-35eef90c-0443-4e90-a8ba-e99cc9b76011 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:33.583931 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-35eef90c-0443-4e90-a8ba-e99cc9b76011 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:33.584419 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-35eef90c-0443-4e90-a8ba-e99cc9b76011 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:33.622171 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-35eef90c-0443-4e90-a8ba-e99cc9b76011 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:33.622406 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-35eef90c-0443-4e90-a8ba-e99cc9b76011 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:33.623059 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-35eef90c-0443-4e90-a8ba-e99cc9b76011 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lazy-loading 'fault' on Instance uuid eacc5386-d3bd-4440-8275-077517fbd610 {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:48:33.666355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-35eef90c-0443-4e90-a8ba-e99cc9b76011 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:33.676631 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-35eef90c-0443-4e90-a8ba-e99cc9b76011 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 200 len: 1230 microversion: 2.1 time: 0.111123 Aug 10 03:48:33.677548 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 675/1317] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:33 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 1230 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:48:34.694547 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-64f76b4d-7c4a-440c-ac90-931ac591ad44 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:34.695242 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-64f76b4d-7c4a-440c-ac90-931ac591ad44 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:34.702396 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-64f76b4d-7c4a-440c-ac90-931ac591ad44 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:34.707628 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-64f76b4d-7c4a-440c-ac90-931ac591ad44 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:34.707628 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-64f76b4d-7c4a-440c-ac90-931ac591ad44 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:34.707628 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-64f76b4d-7c4a-440c-ac90-931ac591ad44 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:34.717846 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-64f76b4d-7c4a-440c-ac90-931ac591ad44 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] HTTP exception thrown: Instance eacc5386-d3bd-4440-8275-077517fbd610 could not be found. Aug 10 03:48:34.718473 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-64f76b4d-7c4a-440c-ac90-931ac591ad44 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Returning 404 to user: Instance eacc5386-d3bd-4440-8275-077517fbd610 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:48:34.719282 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-64f76b4d-7c4a-440c-ac90-931ac591ad44 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 404 len: 111 microversion: 2.1 time: 0.028770 Aug 10 03:48:34.719793 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 643/1318] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:34 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:48:34.815518 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1655646851", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1043484335", "security_groups": [{"name": "tempest-secgroup-smoke-1749124737"}], "block_device_mapping_v2": [{"uuid": "717d9e05-46ba-45db-b365-1e8243803dd7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ef50702a-750c-4693-9c57-2aafe4903705"}]}} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:48:34.921342 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.network.neutron [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] validate_networks() for [('ef50702a-750c-4693-9c57-2aafe4903705', None, None, None)] {{(pid=108439) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:48:35.291340 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Flavor limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:48:35.291758 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Image limits 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:48:35.292311 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Flavor pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:48:35.292744 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Image pref 0:0:0 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:48:35.293152 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.virt.hardware [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:48:35.301655 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:35.302105 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:35.303463 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:35.303899 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:35.321103 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Getting quotas for project 640c843532144cd4ac804d005116e62c. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:48:35.324895 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.quota [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Getting quotas for user 8b443000b4ae4082ac0da4f090ede3b7 and project 640c843532144cd4ac804d005116e62c. Resources: {'instances', 'ram', 'cores'} {{(pid=108439) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:48:35.385883 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Going to run 1 instances... {{(pid=108439) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:48:35.388013 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='717d9e05-46ba-45db-b365-1e8243803dd7',volume_size=None,volume_type=None)] {{(pid=108439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:48:35.910180 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-0afb248c-f3a5-46ac-9772-cd09bcba11be tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.098236 Aug 10 03:48:35.911021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 676/1319] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:48:34 2021] POST /compute/v2.1/servers => generated 406 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 03:48:35.920451 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-95a6136c-d56b-47d9-99ed-58fba5a66993 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:35.921183 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-95a6136c-d56b-47d9-99ed-58fba5a66993 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:35.973651 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-95a6136c-d56b-47d9-99ed-58fba5a66993 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:35.980671 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-95a6136c-d56b-47d9-99ed-58fba5a66993 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1095 microversion: 2.1 time: 0.063815 Aug 10 03:48:35.981369 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 644/1320] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:35 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:48:36.997825 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-456f274b-3941-4e9d-bc81-e332ba7b5b08 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:36.998440 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-456f274b-3941-4e9d-bc81-e332ba7b5b08 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:37.005043 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-456f274b-3941-4e9d-bc81-e332ba7b5b08 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:37.005495 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-456f274b-3941-4e9d-bc81-e332ba7b5b08 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:37.006961 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-456f274b-3941-4e9d-bc81-e332ba7b5b08 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:37.007397 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-456f274b-3941-4e9d-bc81-e332ba7b5b08 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:37.066438 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-456f274b-3941-4e9d-bc81-e332ba7b5b08 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:37.075144 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-456f274b-3941-4e9d-bc81-e332ba7b5b08 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1145 microversion: 2.1 time: 0.080956 Aug 10 03:48:37.075749 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 677/1321] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:36 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:38.093832 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-9100f6ab-259a-4298-acd8-aacc8c942017 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:38.094402 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-9100f6ab-259a-4298-acd8-aacc8c942017 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:38.100929 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9100f6ab-259a-4298-acd8-aacc8c942017 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:38.101475 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9100f6ab-259a-4298-acd8-aacc8c942017 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:38.102284 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9100f6ab-259a-4298-acd8-aacc8c942017 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:38.102715 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-9100f6ab-259a-4298-acd8-aacc8c942017 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:38.162230 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-9100f6ab-259a-4298-acd8-aacc8c942017 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:38.169648 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-9100f6ab-259a-4298-acd8-aacc8c942017 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1193 microversion: 2.1 time: 0.079548 Aug 10 03:48:38.170206 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 645/1322] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:38 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1193 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:39.186448 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-7cabe676-60ce-48a5-af33-d718a3c07ab9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:39.187044 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-7cabe676-60ce-48a5-af33-d718a3c07ab9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:39.192816 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7cabe676-60ce-48a5-af33-d718a3c07ab9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:39.193840 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7cabe676-60ce-48a5-af33-d718a3c07ab9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:39.194607 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7cabe676-60ce-48a5-af33-d718a3c07ab9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:39.195058 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-7cabe676-60ce-48a5-af33-d718a3c07ab9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:39.322006 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-7cabe676-60ce-48a5-af33-d718a3c07ab9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:39.330855 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-7cabe676-60ce-48a5-af33-d718a3c07ab9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1279 microversion: 2.1 time: 0.148124 Aug 10 03:48:39.331651 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 678/1323] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:39 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1279 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:40.237274 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-35518553-0621-4d64-8f38-8fed7481bf06 req-3daaeb86-6c08-4868-a2b7-d1a818e91d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72aab090-5259-4a34-ab2e-4e8f51b2c3ec", "tag": "2d9e8850-bd9b-481a-a97f-447f711c167c"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:48:40.239624 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:48:40.239624 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:48:40.252952 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-35518553-0621-4d64-8f38-8fed7481bf06 req-3daaeb86-6c08-4868-a2b7-d1a818e91d61 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:40.253516 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-35518553-0621-4d64-8f38-8fed7481bf06 req-3daaeb86-6c08-4868-a2b7-d1a818e91d61 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:40.266498 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-35518553-0621-4d64-8f38-8fed7481bf06 req-3daaeb86-6c08-4868-a2b7-d1a818e91d61 service nova] Creating event network-changed:2d9e8850-bd9b-481a-a97f-447f711c167c for instance 72aab090-5259-4a34-ab2e-4e8f51b2c3ec on hv-cinder-78239 Aug 10 03:48:40.272603 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-35518553-0621-4d64-8f38-8fed7481bf06 req-3daaeb86-6c08-4868-a2b7-d1a818e91d61 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039097 Aug 10 03:48:40.273195 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 646/1324] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:48:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:48:40.347614 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ab90ef15-0654-4ab0-bc4b-ca1abdf45078 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:40.348457 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ab90ef15-0654-4ab0-bc4b-ca1abdf45078 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:40.355074 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ab90ef15-0654-4ab0-bc4b-ca1abdf45078 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:40.356107 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ab90ef15-0654-4ab0-bc4b-ca1abdf45078 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:40.357171 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ab90ef15-0654-4ab0-bc4b-ca1abdf45078 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:40.357825 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ab90ef15-0654-4ab0-bc4b-ca1abdf45078 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:40.484451 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ab90ef15-0654-4ab0-bc4b-ca1abdf45078 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:40.492921 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ab90ef15-0654-4ab0-bc4b-ca1abdf45078 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.148944 Aug 10 03:48:40.493483 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 679/1325] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:40 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:41.510353 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0a29bddb-b848-4a63-a1a7-43f8de00592b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:41.511050 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0a29bddb-b848-4a63-a1a7-43f8de00592b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:41.517323 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0a29bddb-b848-4a63-a1a7-43f8de00592b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:41.517813 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0a29bddb-b848-4a63-a1a7-43f8de00592b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:41.518542 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0a29bddb-b848-4a63-a1a7-43f8de00592b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:41.518972 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0a29bddb-b848-4a63-a1a7-43f8de00592b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:41.651855 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0a29bddb-b848-4a63-a1a7-43f8de00592b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:41.659378 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0a29bddb-b848-4a63-a1a7-43f8de00592b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.153104 Aug 10 03:48:41.659937 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 647/1326] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:41 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:42.675900 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d3873d80-1421-4a65-86cf-bbd302ec7b2b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:42.676593 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d3873d80-1421-4a65-86cf-bbd302ec7b2b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:42.683275 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d3873d80-1421-4a65-86cf-bbd302ec7b2b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:42.683718 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d3873d80-1421-4a65-86cf-bbd302ec7b2b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:42.684499 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d3873d80-1421-4a65-86cf-bbd302ec7b2b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:42.685083 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d3873d80-1421-4a65-86cf-bbd302ec7b2b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:42.803908 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d3873d80-1421-4a65-86cf-bbd302ec7b2b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:42.811174 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d3873d80-1421-4a65-86cf-bbd302ec7b2b tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.139174 Aug 10 03:48:42.811732 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 680/1327] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:42 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:43.828002 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-fcc40b46-6f49-4985-94b8-dedf3d850c4d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:43.828644 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-fcc40b46-6f49-4985-94b8-dedf3d850c4d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:43.834358 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fcc40b46-6f49-4985-94b8-dedf3d850c4d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:43.834790 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fcc40b46-6f49-4985-94b8-dedf3d850c4d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:43.835582 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fcc40b46-6f49-4985-94b8-dedf3d850c4d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:43.836003 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-fcc40b46-6f49-4985-94b8-dedf3d850c4d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:43.956634 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-fcc40b46-6f49-4985-94b8-dedf3d850c4d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:43.964533 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-fcc40b46-6f49-4985-94b8-dedf3d850c4d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.140174 Aug 10 03:48:43.965101 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 648/1328] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:43 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:48:44.981341 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-ce38cdfd-c81c-4a10-8372-895617c6f3dd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:44.982307 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-ce38cdfd-c81c-4a10-8372-895617c6f3dd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:44.990298 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce38cdfd-c81c-4a10-8372-895617c6f3dd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:44.990743 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce38cdfd-c81c-4a10-8372-895617c6f3dd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:44.991508 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce38cdfd-c81c-4a10-8372-895617c6f3dd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:44.991937 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-ce38cdfd-c81c-4a10-8372-895617c6f3dd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:45.115711 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-ce38cdfd-c81c-4a10-8372-895617c6f3dd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:45.122932 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-ce38cdfd-c81c-4a10-8372-895617c6f3dd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.145526 Aug 10 03:48:45.123489 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 681/1329] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:44 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:46.140773 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-29380b60-0d11-4b3f-95b3-169964bb5e0a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:46.141541 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-29380b60-0d11-4b3f-95b3-169964bb5e0a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:46.148344 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-29380b60-0d11-4b3f-95b3-169964bb5e0a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:46.148782 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-29380b60-0d11-4b3f-95b3-169964bb5e0a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:46.149540 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-29380b60-0d11-4b3f-95b3-169964bb5e0a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:46.149967 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-29380b60-0d11-4b3f-95b3-169964bb5e0a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:46.271609 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-29380b60-0d11-4b3f-95b3-169964bb5e0a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:46.280020 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-29380b60-0d11-4b3f-95b3-169964bb5e0a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.143653 Aug 10 03:48:46.280781 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 649/1330] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:46 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:47.296782 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8910b396-4e73-4ae7-a0c5-1006a5861171 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:47.297413 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8910b396-4e73-4ae7-a0c5-1006a5861171 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:47.303722 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8910b396-4e73-4ae7-a0c5-1006a5861171 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:47.304163 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8910b396-4e73-4ae7-a0c5-1006a5861171 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:47.304942 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8910b396-4e73-4ae7-a0c5-1006a5861171 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:47.305376 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8910b396-4e73-4ae7-a0c5-1006a5861171 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:47.423018 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8910b396-4e73-4ae7-a0c5-1006a5861171 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:47.431131 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8910b396-4e73-4ae7-a0c5-1006a5861171 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.138172 Aug 10 03:48:47.431694 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 682/1331] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:47 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:48.447443 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0f86fa06-1cc2-42d0-9717-0cb2e45a32b2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:48.448088 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0f86fa06-1cc2-42d0-9717-0cb2e45a32b2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:48.453897 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f86fa06-1cc2-42d0-9717-0cb2e45a32b2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:48.454363 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f86fa06-1cc2-42d0-9717-0cb2e45a32b2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:48.455116 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f86fa06-1cc2-42d0-9717-0cb2e45a32b2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:48.455539 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0f86fa06-1cc2-42d0-9717-0cb2e45a32b2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:48.576396 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0f86fa06-1cc2-42d0-9717-0cb2e45a32b2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:48.583477 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0f86fa06-1cc2-42d0-9717-0cb2e45a32b2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.139614 Aug 10 03:48:48.584017 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 650/1332] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:48 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 03:48:49.598927 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-713196ca-7c76-4ebc-a28c-cb579929d0d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:49.600109 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-713196ca-7c76-4ebc-a28c-cb579929d0d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:49.606163 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-713196ca-7c76-4ebc-a28c-cb579929d0d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:49.606602 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-713196ca-7c76-4ebc-a28c-cb579929d0d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:49.607356 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-713196ca-7c76-4ebc-a28c-cb579929d0d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:49.607784 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-713196ca-7c76-4ebc-a28c-cb579929d0d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:49.725373 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-713196ca-7c76-4ebc-a28c-cb579929d0d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:49.733468 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-713196ca-7c76-4ebc-a28c-cb579929d0d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.138189 Aug 10 03:48:49.734032 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 683/1333] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:49 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:50.749917 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-31294823-1113-4b34-a589-38c600431b50 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:50.750595 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-31294823-1113-4b34-a589-38c600431b50 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:50.756974 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-31294823-1113-4b34-a589-38c600431b50 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:50.757412 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-31294823-1113-4b34-a589-38c600431b50 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:50.758242 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-31294823-1113-4b34-a589-38c600431b50 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:50.758667 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-31294823-1113-4b34-a589-38c600431b50 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:50.878054 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-31294823-1113-4b34-a589-38c600431b50 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:50.885277 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-31294823-1113-4b34-a589-38c600431b50 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.139136 Aug 10 03:48:50.885828 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 651/1334] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:50 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:51.901869 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1e113fa7-ca4f-42ab-b761-99221c3e8d91 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:51.902544 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1e113fa7-ca4f-42ab-b761-99221c3e8d91 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:51.908352 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e113fa7-ca4f-42ab-b761-99221c3e8d91 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:51.908793 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e113fa7-ca4f-42ab-b761-99221c3e8d91 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:51.909542 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e113fa7-ca4f-42ab-b761-99221c3e8d91 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:51.909973 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1e113fa7-ca4f-42ab-b761-99221c3e8d91 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:52.030402 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1e113fa7-ca4f-42ab-b761-99221c3e8d91 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:52.037672 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1e113fa7-ca4f-42ab-b761-99221c3e8d91 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.139395 Aug 10 03:48:52.038223 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 684/1335] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:51 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:53.053770 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0471a5b5-5af6-4fc1-ae0f-ee80a7d2500e tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:53.054360 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0471a5b5-5af6-4fc1-ae0f-ee80a7d2500e tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:53.060211 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0471a5b5-5af6-4fc1-ae0f-ee80a7d2500e tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:53.060662 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0471a5b5-5af6-4fc1-ae0f-ee80a7d2500e tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:53.061474 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0471a5b5-5af6-4fc1-ae0f-ee80a7d2500e tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:53.061908 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0471a5b5-5af6-4fc1-ae0f-ee80a7d2500e tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:53.183834 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0471a5b5-5af6-4fc1-ae0f-ee80a7d2500e tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:53.191090 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0471a5b5-5af6-4fc1-ae0f-ee80a7d2500e tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.141047 Aug 10 03:48:53.191638 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 652/1336] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:53 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:54.208117 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6bbc4ee9-8d2c-4ea3-8382-eb48b9472c6a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:54.209261 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6bbc4ee9-8d2c-4ea3-8382-eb48b9472c6a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:54.215021 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6bbc4ee9-8d2c-4ea3-8382-eb48b9472c6a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:54.218313 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6bbc4ee9-8d2c-4ea3-8382-eb48b9472c6a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:54.218313 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6bbc4ee9-8d2c-4ea3-8382-eb48b9472c6a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:54.218313 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6bbc4ee9-8d2c-4ea3-8382-eb48b9472c6a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:54.336845 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6bbc4ee9-8d2c-4ea3-8382-eb48b9472c6a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:54.344441 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6bbc4ee9-8d2c-4ea3-8382-eb48b9472c6a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.140062 Aug 10 03:48:54.345216 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 685/1337] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:54 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:55.361865 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-d908ebdf-1263-49d1-97f0-fc45b08cd52a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:55.362466 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-d908ebdf-1263-49d1-97f0-fc45b08cd52a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:55.368487 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d908ebdf-1263-49d1-97f0-fc45b08cd52a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:55.368926 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d908ebdf-1263-49d1-97f0-fc45b08cd52a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:55.369677 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d908ebdf-1263-49d1-97f0-fc45b08cd52a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:55.370258 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-d908ebdf-1263-49d1-97f0-fc45b08cd52a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:55.492620 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-d908ebdf-1263-49d1-97f0-fc45b08cd52a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:55.500344 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-d908ebdf-1263-49d1-97f0-fc45b08cd52a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.142073 Aug 10 03:48:55.500902 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 653/1338] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:55 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:56.517049 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-1fd21c18-e5f2-4868-a135-22e4d1287319 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:56.517837 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-1fd21c18-e5f2-4868-a135-22e4d1287319 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:56.523962 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1fd21c18-e5f2-4868-a135-22e4d1287319 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:56.524645 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1fd21c18-e5f2-4868-a135-22e4d1287319 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:56.525271 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1fd21c18-e5f2-4868-a135-22e4d1287319 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:56.525898 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-1fd21c18-e5f2-4868-a135-22e4d1287319 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:56.562456 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-46ccaf9a-7de5-469d-94c3-b51d5a769db9 req-28f35bc4-9ff2-4a10-b8fb-7fd409ea06ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72aab090-5259-4a34-ab2e-4e8f51b2c3ec", "name": "network-vif-plugged", "status": "completed", "tag": "2d9e8850-bd9b-481a-a97f-447f711c167c"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:48:56.563959 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:48:56.563959 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:48:56.573895 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-46ccaf9a-7de5-469d-94c3-b51d5a769db9 req-28f35bc4-9ff2-4a10-b8fb-7fd409ea06ae service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:56.573895 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-46ccaf9a-7de5-469d-94c3-b51d5a769db9 req-28f35bc4-9ff2-4a10-b8fb-7fd409ea06ae service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:56.583734 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-46ccaf9a-7de5-469d-94c3-b51d5a769db9 req-28f35bc4-9ff2-4a10-b8fb-7fd409ea06ae service nova] Creating event network-vif-plugged:2d9e8850-bd9b-481a-a97f-447f711c167c for instance 72aab090-5259-4a34-ab2e-4e8f51b2c3ec on hv-cinder-78239 Aug 10 03:48:56.588583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-46ccaf9a-7de5-469d-94c3-b51d5a769db9 req-28f35bc4-9ff2-4a10-b8fb-7fd409ea06ae service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029619 Aug 10 03:48:56.589181 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 654/1339] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:48:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:48:56.653857 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-1fd21c18-e5f2-4868-a135-22e4d1287319 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:56.661143 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-1fd21c18-e5f2-4868-a135-22e4d1287319 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.148000 Aug 10 03:48:56.662235 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 686/1340] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:56 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:57.679239 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-47a608c0-d0aa-4d8b-b1ff-d89f646b75b3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:57.679956 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-47a608c0-d0aa-4d8b-b1ff-d89f646b75b3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:57.686082 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-47a608c0-d0aa-4d8b-b1ff-d89f646b75b3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:57.686518 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-47a608c0-d0aa-4d8b-b1ff-d89f646b75b3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:57.690519 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-47a608c0-d0aa-4d8b-b1ff-d89f646b75b3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:57.690519 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-47a608c0-d0aa-4d8b-b1ff-d89f646b75b3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:57.810739 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-47a608c0-d0aa-4d8b-b1ff-d89f646b75b3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:57.818702 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-47a608c0-d0aa-4d8b-b1ff-d89f646b75b3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1267 microversion: 2.1 time: 0.144129 Aug 10 03:48:57.819252 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 655/1341] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:57 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:58.835400 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-282fe95b-fba6-4c0b-b56b-a4616e55d420 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:58.836043 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-282fe95b-fba6-4c0b-b56b-a4616e55d420 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:58.841950 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-282fe95b-fba6-4c0b-b56b-a4616e55d420 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:58.842392 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-282fe95b-fba6-4c0b-b56b-a4616e55d420 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:58.843154 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-282fe95b-fba6-4c0b-b56b-a4616e55d420 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:58.843588 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-282fe95b-fba6-4c0b-b56b-a4616e55d420 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:58.960356 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-282fe95b-fba6-4c0b-b56b-a4616e55d420 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:58.967767 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-282fe95b-fba6-4c0b-b56b-a4616e55d420 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1454 microversion: 2.1 time: 0.136082 Aug 10 03:48:58.968355 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 687/1342] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:58 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:48:58.983968 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-e2b8c99c-d8ab-4a4c-bcf1-ef11c4401cd4 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:48:58.984602 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-e2b8c99c-d8ab-4a4c-bcf1-ef11c4401cd4 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:48:58.990905 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e2b8c99c-d8ab-4a4c-bcf1-ef11c4401cd4 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:58.997238 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e2b8c99c-d8ab-4a4c-bcf1-ef11c4401cd4 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:58.997238 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e2b8c99c-d8ab-4a4c-bcf1-ef11c4401cd4 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:48:58.997238 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-e2b8c99c-d8ab-4a4c-bcf1-ef11c4401cd4 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:48:59.111206 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-e2b8c99c-d8ab-4a4c-bcf1-ef11c4401cd4 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:48:59.119107 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-e2b8c99c-d8ab-4a4c-bcf1-ef11c4401cd4 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1454 microversion: 2.1 time: 0.138781 Aug 10 03:48:59.119659 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 656/1343] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:48:58 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:49:01.147556 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-40943144-cb93-49bb-8bcc-1a572dbcb1e1 req-c933e7fa-11ed-482c-91b3-8a2d1ef53160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72aab090-5259-4a34-ab2e-4e8f51b2c3ec", "tag": "2d9e8850-bd9b-481a-a97f-447f711c167c"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:49:01.149139 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:49:01.149139 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:49:01.155927 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-40943144-cb93-49bb-8bcc-1a572dbcb1e1 req-c933e7fa-11ed-482c-91b3-8a2d1ef53160 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:49:01.158946 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-40943144-cb93-49bb-8bcc-1a572dbcb1e1 req-c933e7fa-11ed-482c-91b3-8a2d1ef53160 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:49:01.167722 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-40943144-cb93-49bb-8bcc-1a572dbcb1e1 req-c933e7fa-11ed-482c-91b3-8a2d1ef53160 service nova] Creating event network-changed:2d9e8850-bd9b-481a-a97f-447f711c167c for instance 72aab090-5259-4a34-ab2e-4e8f51b2c3ec on hv-cinder-78239 Aug 10 03:49:01.173109 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-40943144-cb93-49bb-8bcc-1a572dbcb1e1 req-c933e7fa-11ed-482c-91b3-8a2d1ef53160 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029126 Aug 10 03:49:01.173757 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 688/1344] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:49:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:49:21.811320 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 03:49:21.811936 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: Tue Aug 10 03:49:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 03:50:37.061381 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1406948270", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1043484335", "security_groups": [{"name": "tempest-secgroup-smoke-1749124737"}], "block_device_mapping_v2": [{"uuid": "be00aa0c-0db7-4288-aeba-59a0bf9dda80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ef50702a-750c-4693-9c57-2aafe4903705"}]}} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:50:37.315742 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.network.neutron [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] validate_networks() for [('ef50702a-750c-4693-9c57-2aafe4903705', None, None, None)] {{(pid=108440) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 03:50:37.734559 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Flavor limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 03:50:37.734984 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Image limits 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 03:50:37.735450 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Flavor pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 03:50:37.735848 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Image pref 0:0:0 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 03:50:37.736275 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.virt.hardware [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 03:50:37.745820 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:37.746542 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:37.747813 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:37.748522 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:37.766357 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Getting quotas for project 640c843532144cd4ac804d005116e62c. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 03:50:37.770184 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.quota [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Getting quotas for user 8b443000b4ae4082ac0da4f090ede3b7 and project 640c843532144cd4ac804d005116e62c. Resources: {'instances', 'ram', 'cores'} {{(pid=108440) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 03:50:37.829696 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Going to run 1 instances... {{(pid=108440) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 03:50:37.832395 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be00aa0c-0db7-4288-aeba-59a0bf9dda80',volume_size=None,volume_type=None)] {{(pid=108440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 03:50:38.798718 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-aae22ad7-cd92-4a70-9d39-ab8e5f51e689 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.741450 Aug 10 03:50:38.800385 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 657/1345] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 10 03:50:37 2021] POST /compute/v2.1/servers => generated 406 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 03:50:38.809024 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b741819f-04ee-419b-9c9f-d9493183c04f] AMQP server on 10.222.0.21:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 10 03:50:38.868650 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-4640a2cf-3c70-418d-ad5e-27362c8a2e25 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:38.869376 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-4640a2cf-3c70-418d-ad5e-27362c8a2e25 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:38.976649 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-4640a2cf-3c70-418d-ad5e-27362c8a2e25 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:38.983423 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-4640a2cf-3c70-418d-ad5e-27362c8a2e25 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1095 microversion: 2.1 time: 0.176649 Aug 10 03:50:38.983988 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 689/1346] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:38 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1095 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:40.000543 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-f3cc3816-4612-4362-919f-0fea0faeaef7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:40.001155 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-f3cc3816-4612-4362-919f-0fea0faeaef7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:40.007736 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f3cc3816-4612-4362-919f-0fea0faeaef7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:40.008178 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f3cc3816-4612-4362-919f-0fea0faeaef7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:40.008975 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f3cc3816-4612-4362-919f-0fea0faeaef7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:40.009450 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-f3cc3816-4612-4362-919f-0fea0faeaef7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:40.070474 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-f3cc3816-4612-4362-919f-0fea0faeaef7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:40.077827 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-f3cc3816-4612-4362-919f-0fea0faeaef7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1145 microversion: 2.1 time: 0.080970 Aug 10 03:50:40.078392 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 658/1347] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:39 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:41.094731 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-d670d6d6-1e41-4845-9351-5db2deb67ae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:41.095356 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-d670d6d6-1e41-4845-9351-5db2deb67ae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:41.119338 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d670d6d6-1e41-4845-9351-5db2deb67ae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:41.119338 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d670d6d6-1e41-4845-9351-5db2deb67ae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:41.119338 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d670d6d6-1e41-4845-9351-5db2deb67ae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:41.119338 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-d670d6d6-1e41-4845-9351-5db2deb67ae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:41.136799 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO oslo.messaging._drivers.impl_rabbit [-] [b741819f-04ee-419b-9c9f-d9493183c04f] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 49398. Aug 10 03:50:41.185043 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-d670d6d6-1e41-4845-9351-5db2deb67ae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:41.192311 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-d670d6d6-1e41-4845-9351-5db2deb67ae2 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1201 microversion: 2.1 time: 0.101262 Aug 10 03:50:41.193277 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 690/1348] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:41 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1201 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:42.209833 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-c561e3fe-fce2-4de1-9985-b308e33a3e3d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:42.210348 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-c561e3fe-fce2-4de1-9985-b308e33a3e3d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:42.216437 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c561e3fe-fce2-4de1-9985-b308e33a3e3d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:42.216881 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c561e3fe-fce2-4de1-9985-b308e33a3e3d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:42.217655 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c561e3fe-fce2-4de1-9985-b308e33a3e3d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:42.218077 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-c561e3fe-fce2-4de1-9985-b308e33a3e3d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:42.459911 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-c561e3fe-fce2-4de1-9985-b308e33a3e3d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:42.467275 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-c561e3fe-fce2-4de1-9985-b308e33a3e3d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1279 microversion: 2.1 time: 0.261746 Aug 10 03:50:42.467836 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 659/1349] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:42 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1279 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:43.092940 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-8919526e-fd86-4099-8f58-1fb7e4f2785b req-98543083-2f01-4333-8a61-9186ed689a16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c", "tag": "cebddeda-6ad6-468e-b7b2-3c14c996ec9d"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:50:43.094523 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:50:43.094523 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:50:43.102707 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-8919526e-fd86-4099-8f58-1fb7e4f2785b req-98543083-2f01-4333-8a61-9186ed689a16 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:43.103151 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-8919526e-fd86-4099-8f58-1fb7e4f2785b req-98543083-2f01-4333-8a61-9186ed689a16 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:43.119517 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-8919526e-fd86-4099-8f58-1fb7e4f2785b req-98543083-2f01-4333-8a61-9186ed689a16 service nova] Creating event network-changed:cebddeda-6ad6-468e-b7b2-3c14c996ec9d for instance 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c on hv-cinder-78239 Aug 10 03:50:43.124805 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-8919526e-fd86-4099-8f58-1fb7e4f2785b req-98543083-2f01-4333-8a61-9186ed689a16 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093231 Aug 10 03:50:43.125699 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 691/1350] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:50:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:50:43.484435 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-0350aa19-4794-4002-b486-5bdaef72ce4f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:43.485176 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-0350aa19-4794-4002-b486-5bdaef72ce4f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:43.491418 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0350aa19-4794-4002-b486-5bdaef72ce4f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:43.491852 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0350aa19-4794-4002-b486-5bdaef72ce4f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:43.492649 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0350aa19-4794-4002-b486-5bdaef72ce4f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:43.493071 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-0350aa19-4794-4002-b486-5bdaef72ce4f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:43.734603 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-0350aa19-4794-4002-b486-5bdaef72ce4f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:43.742878 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-0350aa19-4794-4002-b486-5bdaef72ce4f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1267 microversion: 2.1 time: 0.262158 Aug 10 03:50:43.743400 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 660/1351] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:43 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:44.759879 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a9de9855-7212-4f09-abb9-e332c7c032f7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:44.760600 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a9de9855-7212-4f09-abb9-e332c7c032f7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:44.766535 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a9de9855-7212-4f09-abb9-e332c7c032f7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:44.766976 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a9de9855-7212-4f09-abb9-e332c7c032f7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:44.767734 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a9de9855-7212-4f09-abb9-e332c7c032f7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:44.769177 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a9de9855-7212-4f09-abb9-e332c7c032f7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:44.892002 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a9de9855-7212-4f09-abb9-e332c7c032f7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:44.899858 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a9de9855-7212-4f09-abb9-e332c7c032f7 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1267 microversion: 2.1 time: 0.144009 Aug 10 03:50:44.900452 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 692/1352] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:44 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:45.916255 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-ca948dc3-e38a-45cb-b605-aff9a1c8d5eb tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:45.916843 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-ca948dc3-e38a-45cb-b605-aff9a1c8d5eb tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:45.922630 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ca948dc3-e38a-45cb-b605-aff9a1c8d5eb tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:45.923065 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ca948dc3-e38a-45cb-b605-aff9a1c8d5eb tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:45.923825 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ca948dc3-e38a-45cb-b605-aff9a1c8d5eb tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:45.924773 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-ca948dc3-e38a-45cb-b605-aff9a1c8d5eb tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:46.046041 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-ca948dc3-e38a-45cb-b605-aff9a1c8d5eb tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:46.053817 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-ca948dc3-e38a-45cb-b605-aff9a1c8d5eb tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1267 microversion: 2.1 time: 0.141253 Aug 10 03:50:46.054372 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 661/1353] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:45 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:47.070955 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e3c0feb9-644b-43cb-9ed5-6a713bde6e3c tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:47.071560 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e3c0feb9-644b-43cb-9ed5-6a713bde6e3c tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:47.077431 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3c0feb9-644b-43cb-9ed5-6a713bde6e3c tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:47.077874 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3c0feb9-644b-43cb-9ed5-6a713bde6e3c tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:47.078632 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3c0feb9-644b-43cb-9ed5-6a713bde6e3c tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:47.079062 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e3c0feb9-644b-43cb-9ed5-6a713bde6e3c tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:47.196130 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e3c0feb9-644b-43cb-9ed5-6a713bde6e3c tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:47.203260 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e3c0feb9-644b-43cb-9ed5-6a713bde6e3c tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1267 microversion: 2.1 time: 0.136063 Aug 10 03:50:47.203817 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 693/1354] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:47 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:48.220093 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-62a6a96b-1bab-4377-9909-b7f382a98c7d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:48.220736 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-62a6a96b-1bab-4377-9909-b7f382a98c7d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:48.226626 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-62a6a96b-1bab-4377-9909-b7f382a98c7d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:48.227310 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-62a6a96b-1bab-4377-9909-b7f382a98c7d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:48.228079 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-62a6a96b-1bab-4377-9909-b7f382a98c7d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:48.228537 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-62a6a96b-1bab-4377-9909-b7f382a98c7d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:48.357402 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-62a6a96b-1bab-4377-9909-b7f382a98c7d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:48.364737 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-62a6a96b-1bab-4377-9909-b7f382a98c7d tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1267 microversion: 2.1 time: 0.148197 Aug 10 03:50:48.365217 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 662/1355] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:48 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:49.380961 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a25125e7-2fd1-4e45-9c59-309e4fc34f57 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:49.381565 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a25125e7-2fd1-4e45-9c59-309e4fc34f57 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:49.387393 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a25125e7-2fd1-4e45-9c59-309e4fc34f57 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:49.387831 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a25125e7-2fd1-4e45-9c59-309e4fc34f57 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:49.388612 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a25125e7-2fd1-4e45-9c59-309e4fc34f57 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:49.389042 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a25125e7-2fd1-4e45-9c59-309e4fc34f57 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:49.504672 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-a25125e7-2fd1-4e45-9c59-309e4fc34f57 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:49.511887 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a25125e7-2fd1-4e45-9c59-309e4fc34f57 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1267 microversion: 2.1 time: 0.134582 Aug 10 03:50:49.512467 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 694/1356] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:49 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1267 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:50.528220 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-4509b85e-f46f-4052-bd33-292210b9f5f3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:50.528827 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-4509b85e-f46f-4052-bd33-292210b9f5f3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:50.534838 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4509b85e-f46f-4052-bd33-292210b9f5f3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:50.535277 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4509b85e-f46f-4052-bd33-292210b9f5f3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:50.536043 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4509b85e-f46f-4052-bd33-292210b9f5f3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:50.536499 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-4509b85e-f46f-4052-bd33-292210b9f5f3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:50.654948 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-4509b85e-f46f-4052-bd33-292210b9f5f3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:50.662893 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-4509b85e-f46f-4052-bd33-292210b9f5f3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1267 microversion: 2.1 time: 0.138327 Aug 10 03:50:50.663516 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 663/1357] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:50 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:51.678778 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-c586d3ec-9fc6-4403-a88a-302e235d3379 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:51.679411 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-c586d3ec-9fc6-4403-a88a-302e235d3379 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:51.685284 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c586d3ec-9fc6-4403-a88a-302e235d3379 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:51.685724 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c586d3ec-9fc6-4403-a88a-302e235d3379 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:51.686501 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c586d3ec-9fc6-4403-a88a-302e235d3379 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:51.686935 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-c586d3ec-9fc6-4403-a88a-302e235d3379 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:51.812344 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-c586d3ec-9fc6-4403-a88a-302e235d3379 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:51.820440 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-c586d3ec-9fc6-4403-a88a-302e235d3379 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1267 microversion: 2.1 time: 0.145339 Aug 10 03:50:51.821012 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 695/1358] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:51 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:52.836433 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7baa957e-6cae-4df9-ba0a-dcccd04150d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:52.837067 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7baa957e-6cae-4df9-ba0a-dcccd04150d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:52.842942 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7baa957e-6cae-4df9-ba0a-dcccd04150d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:52.843383 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7baa957e-6cae-4df9-ba0a-dcccd04150d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:52.844143 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7baa957e-6cae-4df9-ba0a-dcccd04150d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:52.844602 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7baa957e-6cae-4df9-ba0a-dcccd04150d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:52.965358 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-7baa957e-6cae-4df9-ba0a-dcccd04150d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:52.973245 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7baa957e-6cae-4df9-ba0a-dcccd04150d3 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1267 microversion: 2.1 time: 0.140420 Aug 10 03:50:52.973809 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 664/1359] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:52 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:53.380385 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-a1d8b25e-804c-4ebf-8cef-c046fd79a53c req-83ef7233-1741-495b-b742-5334e6f82dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c", "name": "network-vif-plugged", "status": "completed", "tag": "cebddeda-6ad6-468e-b7b2-3c14c996ec9d"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:50:53.380855 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:50:53.380855 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:50:53.387658 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-a1d8b25e-804c-4ebf-8cef-c046fd79a53c req-83ef7233-1741-495b-b742-5334e6f82dc8 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:53.388093 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-a1d8b25e-804c-4ebf-8cef-c046fd79a53c req-83ef7233-1741-495b-b742-5334e6f82dc8 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:53.399279 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-a1d8b25e-804c-4ebf-8cef-c046fd79a53c req-83ef7233-1741-495b-b742-5334e6f82dc8 service nova] Creating event network-vif-plugged:cebddeda-6ad6-468e-b7b2-3c14c996ec9d for instance 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c on hv-cinder-78239 Aug 10 03:50:53.404305 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-a1d8b25e-804c-4ebf-8cef-c046fd79a53c req-83ef7233-1741-495b-b742-5334e6f82dc8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084427 Aug 10 03:50:53.405069 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 696/1360] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:50:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:50:53.991586 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-be5b141d-acd1-423f-9bfa-f2c35bce808f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:53.992523 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-be5b141d-acd1-423f-9bfa-f2c35bce808f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:53.998939 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-be5b141d-acd1-423f-9bfa-f2c35bce808f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:53.999385 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-be5b141d-acd1-423f-9bfa-f2c35bce808f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:54.000397 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-be5b141d-acd1-423f-9bfa-f2c35bce808f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:54.000992 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-be5b141d-acd1-423f-9bfa-f2c35bce808f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:54.129722 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-be5b141d-acd1-423f-9bfa-f2c35bce808f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:54.137020 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-be5b141d-acd1-423f-9bfa-f2c35bce808f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1267 microversion: 2.1 time: 0.150431 Aug 10 03:50:54.137574 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 665/1361] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:53 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:55.154592 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-6b42500b-3c04-4286-8e5d-76bdbc9cce53 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:55.155281 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-6b42500b-3c04-4286-8e5d-76bdbc9cce53 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:55.161532 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6b42500b-3c04-4286-8e5d-76bdbc9cce53 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:55.161963 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6b42500b-3c04-4286-8e5d-76bdbc9cce53 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:55.162724 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6b42500b-3c04-4286-8e5d-76bdbc9cce53 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:55.163142 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-6b42500b-3c04-4286-8e5d-76bdbc9cce53 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:55.284604 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-6b42500b-3c04-4286-8e5d-76bdbc9cce53 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:55.292124 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-6b42500b-3c04-4286-8e5d-76bdbc9cce53 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1455 microversion: 2.1 time: 0.141513 Aug 10 03:50:55.292879 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 697/1362] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:55 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:55.307654 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-44498818-a3a2-4528-b320-85adce403d27 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:50:55.308289 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-44498818-a3a2-4528-b320-85adce403d27 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:50:55.314067 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44498818-a3a2-4528-b320-85adce403d27 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:55.314511 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44498818-a3a2-4528-b320-85adce403d27 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:55.315767 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44498818-a3a2-4528-b320-85adce403d27 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:55.316211 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-44498818-a3a2-4528-b320-85adce403d27 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:55.437355 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-44498818-a3a2-4528-b320-85adce403d27 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:50:55.445387 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-44498818-a3a2-4528-b320-85adce403d27 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1455 microversion: 2.1 time: 0.141283 Aug 10 03:50:55.445952 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 666/1363] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:50:55 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:50:57.529856 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-0f829ca4-4bf0-4760-97e9-49e41d063420 req-a8951540-abd3-470b-8c7e-607b19f81fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c", "tag": "cebddeda-6ad6-468e-b7b2-3c14c996ec9d"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:50:57.531466 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:50:57.531466 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:50:57.538926 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-0f829ca4-4bf0-4760-97e9-49e41d063420 req-a8951540-abd3-470b-8c7e-607b19f81fd8 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:50:57.539361 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-0f829ca4-4bf0-4760-97e9-49e41d063420 req-a8951540-abd3-470b-8c7e-607b19f81fd8 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:50:57.550690 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-0f829ca4-4bf0-4760-97e9-49e41d063420 req-a8951540-abd3-470b-8c7e-607b19f81fd8 service nova] Creating event network-changed:cebddeda-6ad6-468e-b7b2-3c14c996ec9d for instance 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c on hv-cinder-78239 Aug 10 03:50:57.555795 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-0f829ca4-4bf0-4760-97e9-49e41d063420 req-a8951540-abd3-470b-8c7e-607b19f81fd8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030025 Aug 10 03:50:57.556727 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 698/1364] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:50:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:51:08.985059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 03:51:08.985667 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: Tue Aug 10 03:51:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 03:52:26.182687 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cea58ddc-44b4-412e-b7e9-3663d85a488d] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 03:52:26.186406 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7713b8e7-5595-445c-b680-be475c7cb331 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:52:26.186885 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7713b8e7-5595-445c-b680-be475c7cb331 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:52:26.193480 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7713b8e7-5595-445c-b680-be475c7cb331 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:26.194097 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7713b8e7-5595-445c-b680-be475c7cb331 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:26.194884 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7713b8e7-5595-445c-b680-be475c7cb331 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:26.195002 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-c7bcc6cc-0255-4800-9645-87bbb8d41427 req-d54bee31-73ca-499d-9aeb-fccd84f4cb49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c", "tag": "cebddeda-6ad6-468e-b7b2-3c14c996ec9d"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:52:26.195470 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7713b8e7-5595-445c-b680-be475c7cb331 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:26.196411 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:52:26.196411 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:52:26.203459 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-c7bcc6cc-0255-4800-9645-87bbb8d41427 req-d54bee31-73ca-499d-9aeb-fccd84f4cb49 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:26.204467 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-c7bcc6cc-0255-4800-9645-87bbb8d41427 req-d54bee31-73ca-499d-9aeb-fccd84f4cb49 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:26.215681 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-c7bcc6cc-0255-4800-9645-87bbb8d41427 req-d54bee31-73ca-499d-9aeb-fccd84f4cb49 service nova] Creating event network-changed:cebddeda-6ad6-468e-b7b2-3c14c996ec9d for instance 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c on hv-cinder-78239 Aug 10 03:52:26.221453 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-c7bcc6cc-0255-4800-9645-87bbb8d41427 req-d54bee31-73ca-499d-9aeb-fccd84f4cb49 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031476 Aug 10 03:52:26.222046 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 699/1365] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:52:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:52:26.222707 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7713b8e7-5595-445c-b680-be475c7cb331 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Going to try to terminate instance {{(pid=108440) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:52:26.582075 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7713b8e7-5595-445c-b680-be475c7cb331 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "DELETE /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 204 len: 0 microversion: 2.1 time: 0.400730 Aug 10 03:52:26.583213 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 667/1366] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:52:26 2021] DELETE /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:52:26.592048 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-dacbfbd0-ce95-419f-9ca5-aa3a9b013944 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:52:26.593122 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-dacbfbd0-ce95-419f-9ca5-aa3a9b013944 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:52:26.599433 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dacbfbd0-ce95-419f-9ca5-aa3a9b013944 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:26.600336 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dacbfbd0-ce95-419f-9ca5-aa3a9b013944 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:26.601618 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dacbfbd0-ce95-419f-9ca5-aa3a9b013944 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:26.602289 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-dacbfbd0-ce95-419f-9ca5-aa3a9b013944 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:26.737770 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-dacbfbd0-ce95-419f-9ca5-aa3a9b013944 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:52:26.745535 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-dacbfbd0-ce95-419f-9ca5-aa3a9b013944 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1580 microversion: 2.1 time: 0.157686 Aug 10 03:52:26.746446 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 700/1367] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:52:26 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1580 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:52:27.764892 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-2ccb58be-4296-4862-b85a-0085081d26b8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:52:27.765596 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-2ccb58be-4296-4862-b85a-0085081d26b8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:52:27.782865 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2ccb58be-4296-4862-b85a-0085081d26b8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:27.783308 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2ccb58be-4296-4862-b85a-0085081d26b8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:27.784086 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2ccb58be-4296-4862-b85a-0085081d26b8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:27.784545 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-2ccb58be-4296-4862-b85a-0085081d26b8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:27.790460 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO oslo.messaging._drivers.impl_rabbit [-] [cea58ddc-44b4-412e-b7e9-3663d85a488d] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 49480. Aug 10 03:52:27.916583 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-2ccb58be-4296-4862-b85a-0085081d26b8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:52:27.926725 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-2ccb58be-4296-4862-b85a-0085081d26b8 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1461 microversion: 2.1 time: 0.166010 Aug 10 03:52:27.933417 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 668/1368] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:52:27 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1461 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:52:28.899472 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [req-4fa82ef8-b805-4adb-a454-a8ab07c3bf12 req-06969e55-6d9b-440d-b2f4-029f80e6db79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c", "name": "network-vif-deleted", "tag": "cebddeda-6ad6-468e-b7b2-3c14c996ec9d"}]} {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:52:28.901013 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:52:28.901013 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: warnings.warn(msg) Aug 10 03:52:28.907777 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-4fa82ef8-b805-4adb-a454-a8ab07c3bf12 req-06969e55-6d9b-440d-b2f4-029f80e6db79 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:28.908185 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [req-4fa82ef8-b805-4adb-a454-a8ab07c3bf12 req-06969e55-6d9b-440d-b2f4-029f80e6db79 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:28.919095 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.compute.server_external_events [req-4fa82ef8-b805-4adb-a454-a8ab07c3bf12 req-06969e55-6d9b-440d-b2f4-029f80e6db79 service nova] Creating event network-vif-deleted:cebddeda-6ad6-468e-b7b2-3c14c996ec9d for instance 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c on hv-cinder-78239 Aug 10 03:52:28.924119 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [req-4fa82ef8-b805-4adb-a454-a8ab07c3bf12 req-06969e55-6d9b-440d-b2f4-029f80e6db79 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028297 Aug 10 03:52:28.924739 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 701/1369] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:52:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:52:28.943382 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-59a4028d-8929-49dd-b7c9-06a0c82db3bd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:52:28.943993 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-59a4028d-8929-49dd-b7c9-06a0c82db3bd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:52:28.950028 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-59a4028d-8929-49dd-b7c9-06a0c82db3bd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:28.950479 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-59a4028d-8929-49dd-b7c9-06a0c82db3bd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:28.951255 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-59a4028d-8929-49dd-b7c9-06a0c82db3bd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:28.951686 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-59a4028d-8929-49dd-b7c9-06a0c82db3bd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:29.021239 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-59a4028d-8929-49dd-b7c9-06a0c82db3bd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:52:29.028887 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-59a4028d-8929-49dd-b7c9-06a0c82db3bd tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1393 microversion: 2.1 time: 0.089237 Aug 10 03:52:29.029441 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 669/1370] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:52:28 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1393 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:52:30.046061 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-8ef47d62-286a-43d5-b3a4-9e2558668744 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:52:30.046752 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-8ef47d62-286a-43d5-b3a4-9e2558668744 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:52:30.052812 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ef47d62-286a-43d5-b3a4-9e2558668744 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:30.053251 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ef47d62-286a-43d5-b3a4-9e2558668744 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:30.054020 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ef47d62-286a-43d5-b3a4-9e2558668744 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:30.054446 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ef47d62-286a-43d5-b3a4-9e2558668744 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:30.086893 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ef47d62-286a-43d5-b3a4-9e2558668744 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:30.087336 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-8ef47d62-286a-43d5-b3a4-9e2558668744 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:30.087792 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.objects.instance [None req-8ef47d62-286a-43d5-b3a4-9e2558668744 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lazy-loading 'fault' on Instance uuid 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c {{(pid=108439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 03:52:30.136808 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-8ef47d62-286a-43d5-b3a4-9e2558668744 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:52:30.144904 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-8ef47d62-286a-43d5-b3a4-9e2558668744 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 200 len: 1231 microversion: 2.1 time: 0.102822 Aug 10 03:52:30.146141 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 702/1371] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:52:30 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:52:31.162618 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b541be6f-911c-4836-8111-d428ead04159 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:52:31.163234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-b541be6f-911c-4836-8111-d428ead04159 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:52:31.170216 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b541be6f-911c-4836-8111-d428ead04159 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:31.170216 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b541be6f-911c-4836-8111-d428ead04159 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:31.171059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b541be6f-911c-4836-8111-d428ead04159 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:31.171059 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-b541be6f-911c-4836-8111-d428ead04159 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:31.185234 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-b541be6f-911c-4836-8111-d428ead04159 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] HTTP exception thrown: Instance 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c could not be found. Aug 10 03:52:31.185823 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-b541be6f-911c-4836-8111-d428ead04159 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Returning 404 to user: Instance 988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:52:31.186642 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-b541be6f-911c-4836-8111-d428ead04159 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c" status: 404 len: 111 microversion: 2.1 time: 0.027768 Aug 10 03:52:31.187179 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 670/1372] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:52:31 2021] GET /compute/v2.1/servers/988f0a2f-ba45-4bd7-a833-85d4d5f7ab1c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:52:34.541266 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-a1bd76d6-1573-4686-9a0c-592150cd5a74 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:52:34.541815 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a1bd76d6-1573-4686-9a0c-592150cd5a74 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:52:34.544622 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-ba74d6a5-4304-4101-8d97-c02c50a039ec req-4ebe56a9-476e-4c3c-aa2a-34798f149876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72aab090-5259-4a34-ab2e-4e8f51b2c3ec", "tag": "2d9e8850-bd9b-481a-a97f-447f711c167c"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:52:34.546198 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:52:34.546198 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:52:34.548962 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a1bd76d6-1573-4686-9a0c-592150cd5a74 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:34.549477 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a1bd76d6-1573-4686-9a0c-592150cd5a74 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:34.550318 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a1bd76d6-1573-4686-9a0c-592150cd5a74 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:34.550819 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-a1bd76d6-1573-4686-9a0c-592150cd5a74 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:34.554873 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-ba74d6a5-4304-4101-8d97-c02c50a039ec req-4ebe56a9-476e-4c3c-aa2a-34798f149876 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:34.555573 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-ba74d6a5-4304-4101-8d97-c02c50a039ec req-4ebe56a9-476e-4c3c-aa2a-34798f149876 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:34.567242 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-ba74d6a5-4304-4101-8d97-c02c50a039ec req-4ebe56a9-476e-4c3c-aa2a-34798f149876 service nova] Creating event network-changed:2d9e8850-bd9b-481a-a97f-447f711c167c for instance 72aab090-5259-4a34-ab2e-4e8f51b2c3ec on hv-cinder-78239 Aug 10 03:52:34.573164 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-ba74d6a5-4304-4101-8d97-c02c50a039ec req-4ebe56a9-476e-4c3c-aa2a-34798f149876 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032857 Aug 10 03:52:34.574365 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 671/1373] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:52:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 03:52:34.580090 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-a1bd76d6-1573-4686-9a0c-592150cd5a74 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Going to try to terminate instance {{(pid=108439) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 03:52:34.952068 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-a1bd76d6-1573-4686-9a0c-592150cd5a74 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "DELETE /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 204 len: 0 microversion: 2.1 time: 0.414360 Aug 10 03:52:34.955390 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 703/1374] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:52:34 2021] DELETE /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 03:52:34.961578 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-78237b38-28c3-4191-80cb-1277580c5950 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:52:34.962449 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-78237b38-28c3-4191-80cb-1277580c5950 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:52:34.968937 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-78237b38-28c3-4191-80cb-1277580c5950 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:34.969978 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-78237b38-28c3-4191-80cb-1277580c5950 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:34.970836 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-78237b38-28c3-4191-80cb-1277580c5950 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:34.971265 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-78237b38-28c3-4191-80cb-1277580c5950 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:35.175455 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.policy [None req-78237b38-28c3-4191-80cb-1277580c5950 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108440) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:52:35.182885 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-78237b38-28c3-4191-80cb-1277580c5950 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1578 microversion: 2.1 time: 0.225330 Aug 10 03:52:35.183445 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 672/1375] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:52:34 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:52:36.199733 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-aa2686cf-d225-4502-a9c0-aab48f36533a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:52:36.200465 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-aa2686cf-d225-4502-a9c0-aab48f36533a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:52:36.206428 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aa2686cf-d225-4502-a9c0-aab48f36533a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:36.206870 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aa2686cf-d225-4502-a9c0-aab48f36533a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:36.207644 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aa2686cf-d225-4502-a9c0-aab48f36533a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:36.208076 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-aa2686cf-d225-4502-a9c0-aab48f36533a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:36.329549 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-aa2686cf-d225-4502-a9c0-aab48f36533a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:52:36.337199 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-aa2686cf-d225-4502-a9c0-aab48f36533a tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1460 microversion: 2.1 time: 0.141443 Aug 10 03:52:36.337773 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 704/1376] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:52:36 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1460 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:52:37.134610 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [req-8c71203d-b89b-47dc-a563-b0b4bff264bd req-e1b9c68e-9d79-429c-9922-a2ca19a82c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72aab090-5259-4a34-ab2e-4e8f51b2c3ec", "name": "network-vif-deleted", "tag": "2d9e8850-bd9b-481a-a97f-447f711c167c"}]} {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 03:52:37.136110 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:52:37.136110 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: warnings.warn(msg) Aug 10 03:52:37.143510 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-8c71203d-b89b-47dc-a563-b0b4bff264bd req-e1b9c68e-9d79-429c-9922-a2ca19a82c31 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:37.148406 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [req-8c71203d-b89b-47dc-a563-b0b4bff264bd req-e1b9c68e-9d79-429c-9922-a2ca19a82c31 service nova] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:37.154545 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.compute.server_external_events [req-8c71203d-b89b-47dc-a563-b0b4bff264bd req-e1b9c68e-9d79-429c-9922-a2ca19a82c31 service nova] Creating event network-vif-deleted:2d9e8850-bd9b-481a-a97f-447f711c167c for instance 72aab090-5259-4a34-ab2e-4e8f51b2c3ec on hv-cinder-78239 Aug 10 03:52:37.159471 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [req-8c71203d-b89b-47dc-a563-b0b4bff264bd req-e1b9c68e-9d79-429c-9922-a2ca19a82c31 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028467 Aug 10 03:52:37.160058 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 673/1377] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 10 03:52:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 03:52:37.354897 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-e494d246-4dd8-4c9a-be39-c2f76743f6d9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:52:37.355444 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-e494d246-4dd8-4c9a-be39-c2f76743f6d9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:52:37.361525 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e494d246-4dd8-4c9a-be39-c2f76743f6d9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:37.361969 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e494d246-4dd8-4c9a-be39-c2f76743f6d9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:37.362737 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e494d246-4dd8-4c9a-be39-c2f76743f6d9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:37.363164 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-e494d246-4dd8-4c9a-be39-c2f76743f6d9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:37.426561 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.policy [None req-e494d246-4dd8-4c9a-be39-c2f76743f6d9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b443000b4ae4082ac0da4f090ede3b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640c843532144cd4ac804d005116e62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108439) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 03:52:37.435139 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-e494d246-4dd8-4c9a-be39-c2f76743f6d9 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 200 len: 1226 microversion: 2.1 time: 0.084000 Aug 10 03:52:37.435710 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 705/1378] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:52:37 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 03:52:38.452417 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-05cb97fe-7049-446e-a0c0-6388fee5bda6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:52:38.453197 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-05cb97fe-7049-446e-a0c0-6388fee5bda6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: 72aab090-5259-4a34-ab2e-4e8f51b2c3ec] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:52:38.459851 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-05cb97fe-7049-446e-a0c0-6388fee5bda6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:38.460325 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-05cb97fe-7049-446e-a0c0-6388fee5bda6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:38.461260 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-05cb97fe-7049-446e-a0c0-6388fee5bda6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:38.461710 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-05cb97fe-7049-446e-a0c0-6388fee5bda6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:38.476849 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-05cb97fe-7049-446e-a0c0-6388fee5bda6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] HTTP exception thrown: Instance 72aab090-5259-4a34-ab2e-4e8f51b2c3ec could not be found. Aug 10 03:52:38.478145 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-05cb97fe-7049-446e-a0c0-6388fee5bda6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Returning 404 to user: Instance 72aab090-5259-4a34-ab2e-4e8f51b2c3ec could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:52:38.479148 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-05cb97fe-7049-446e-a0c0-6388fee5bda6 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec" status: 404 len: 111 microversion: 2.1 time: 0.030982 Aug 10 03:52:38.479694 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 674/1379] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:52:38 2021] GET /compute/v2.1/servers/72aab090-5259-4a34-ab2e-4e8f51b2c3ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:52:38.983673 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b6c0c51f-3afc-4982-b939-9ea0e3b31e09 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:52:38.984233 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.compute.api [None req-b6c0c51f-3afc-4982-b939-9ea0e3b31e09 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108439) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:52:38.990760 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b6c0c51f-3afc-4982-b939-9ea0e3b31e09 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:38.991239 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b6c0c51f-3afc-4982-b939-9ea0e3b31e09 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:38.992019 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b6c0c51f-3afc-4982-b939-9ea0e3b31e09 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:38.992495 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG oslo_concurrency.lockutils [None req-b6c0c51f-3afc-4982-b939-9ea0e3b31e09 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:39.006600 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.wsgi [None req-b6c0c51f-3afc-4982-b939-9ea0e3b31e09 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] HTTP exception thrown: Instance eacc5386-d3bd-4440-8275-077517fbd610 could not be found. Aug 10 03:52:39.007054 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-b6c0c51f-3afc-4982-b939-9ea0e3b31e09 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Returning 404 to user: Instance eacc5386-d3bd-4440-8275-077517fbd610 could not be found. {{(pid=108439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:52:39.007880 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-b6c0c51f-3afc-4982-b939-9ea0e3b31e09 tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "DELETE /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 404 len: 111 microversion: 2.1 time: 0.028032 Aug 10 03:52:39.008444 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 706/1380] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 10 03:52:38 2021] DELETE /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:52:39.016350 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7d995f8a-c890-48ce-b0be-8b5de0c46f6f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '>' {{(pid=108440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:52:39.016956 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.compute.api [None req-7d995f8a-c890-48ce-b0be-8b5de0c46f6f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [instance: eacc5386-d3bd-4440-8275-077517fbd610] Fetching instance by UUID {{(pid=108440) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 03:52:39.022826 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7d995f8a-c890-48ce-b0be-8b5de0c46f6f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:39.023263 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7d995f8a-c890-48ce-b0be-8b5de0c46f6f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:39.024024 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7d995f8a-c890-48ce-b0be-8b5de0c46f6f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 03:52:39.024489 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG oslo_concurrency.lockutils [None req-7d995f8a-c890-48ce-b0be-8b5de0c46f6f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Lock "c015e818-e9f7-45c5-a54b-4b6aaf8bfd26" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 03:52:39.037968 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.wsgi [None req-7d995f8a-c890-48ce-b0be-8b5de0c46f6f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] HTTP exception thrown: Instance eacc5386-d3bd-4440-8275-077517fbd610 could not be found. Aug 10 03:52:39.038750 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: DEBUG nova.api.openstack.wsgi [None req-7d995f8a-c890-48ce-b0be-8b5de0c46f6f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Returning 404 to user: Instance eacc5386-d3bd-4440-8275-077517fbd610 could not be found. {{(pid=108440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 03:52:39.039566 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO nova.api.openstack.requestlog [None req-7d995f8a-c890-48ce-b0be-8b5de0c46f6f tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610" status: 404 len: 111 microversion: 2.1 time: 0.026860 Aug 10 03:52:39.040091 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: [pid: 108440|app: 0|req: 675/1381] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 10 03:52:39 2021] GET /compute/v2.1/servers/eacc5386-d3bd-4440-8275-077517fbd610 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 03:52:40.613551 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: DEBUG nova.api.openstack.wsgi [None req-fc738a28-c177-4195-93cd-09e773cbd7bb tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] Calling method '.version_select at 0x7f9793e82940>' {{(pid=108439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 03:52:40.616990 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc738a28-c177-4195-93cd-09e773cbd7bb tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [489261c1-8467-4dbe-996f-3f5d38a8c3c4] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 03:52:41.634661 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO oslo.messaging._drivers.impl_rabbit [None req-fc738a28-c177-4195-93cd-09e773cbd7bb tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] [489261c1-8467-4dbe-996f-3f5d38a8c3c4] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 49544. Aug 10 03:52:41.730513 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO nova.api.openstack.requestlog [None req-fc738a28-c177-4195-93cd-09e773cbd7bb tempest-TestVolumeBootPattern-1252056161 tempest-TestVolumeBootPattern-1252056161-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1043484335" status: 202 len: 0 microversion: 2.1 time: 1.120677 Aug 10 03:52:41.731081 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: [pid: 108439|app: 0|req: 707/1382] 10.222.0.21 () {58 vars in 1263 bytes} [Tue Aug 10 03:52:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1043484335 => generated 0 bytes in 1122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 03:54:18.070358 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 03:54:18.071082 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: Tue Aug 10 03:54:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 03:54:29.004341 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 03:54:29.005052 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: Tue Aug 10 03:54:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 03:54:49.873114 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 03:54:49.873715 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: Tue Aug 10 03:54:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 03:56:01.833376 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 03:56:01.833976 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: Tue Aug 10 03:56:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 03:57:38.088162 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 03:57:38.088787 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: Tue Aug 10 03:57:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 03:57:49.022598 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 03:57:49.023466 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: Tue Aug 10 03:57:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 03:57:55.582008 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 03:57:55.582647 dv-cinder-782390-8-iscsi devstack@n-api.service[108440]: Tue Aug 10 03:57:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 03:58:00.038413 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 03:58:00.039013 dv-cinder-782390-8-iscsi devstack@n-api.service[108439]: Tue Aug 10 03:58:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!